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ART AS REVEALED IN THE DRAW- 
INGS BY PARTICIPANTS’ 
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SECTION I 


DEFINITION AND IMPORTANCE OF 
THE PROBLEM 


IT IS THE purpose of this investigation to 
compare the relative effects of three differentart 
experiences in drawings made in three specific 
problem situations. Since the drawings resulting 
from the three different art experiences were put 
together for the evaluation of all drawings, nu- 
merically equal groups were used, with person- 
nel assigned to each group by random number. 
Beyond this, common action themes for all groups 
allowed comparison of drawings without regard 
for the conditions under which the drawings were 
made. 

With the common problem of creating a draw- 
ing on an action theme the three groups were pro- 
vided with varying amounts and kinds of sensory 
data as follows: 


Control Group (X)—With no sensory material 
provided beyond that in the classroom, following 
the oral presentation of the action theme, this 
group created a drawing. 

Experimental Group 1 (Y)—After oral pre- 
sentation of the action theme, followed by pre- 
sentation of a sound color film containing sensory 
material relevant to the subject matter of the ac- 
tion theme, this group, in the classroom environ- 
ment, created a drawing on the action theme. 

Experimental Group2 (Z)—After oral present- 
ation of the action theme, and with a resource 





person at the site of the field trip to supply sup- 
plementary information, this group, in the field 
trip environment where sensory material rele- 
vant to the subject matter of the action theme was 
present, created a drawing on the action theme. 

Three different action themes were selected 
with an attempt being made to ‘choose the subject 
matter’ from the categories of ‘machines’, ‘an- 
imals’, and ‘people’. An action theme was used, 
rather than a one word subject theme, because it 
was thought that this would offer the student more 
of a.challenge, and give more opportunity for 
creative expression of unique, individual nature. 
The three action themes on which all individuals 
of the three groups made drawings, are as fol- 
lows: 


1. ‘‘Fire Engines Going to a Fire’’ 
2. ‘‘Activity in the Lion Cage’’ 
3. ‘*Active Children in a Country School”’ 


The experimental method of research was 
used, with three college classes in Art. The 
three groups were taken from art classes inas- 
much as: 


a. More directed interest is achieved in this 
way. 

b. Some proficiency is needed by the students 
in the interpretation of sensory data. 

c. Some proficiency is needed in the handling 
of materials. 


On a theoretical level, the study rises out of 





#* A thesis submitted in partial fulfillment of the requirements for the degree of Doctor of vhilosophy, 


University of Wisconsin, 1951, A. S. Barr, advisor. 
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the current need to plan learning experiences 
wisely, and use available time effectively to give 
maximum results. Ina discussion of the func- 
tional art program, Hawley* recommends that 
the program must grow out of, and grow withall 
other learning experiences, and she emphasizes 
the necessity of reaching a greater number of 
students. She also stressed the fact that during 
any one day there are many varied opportunities 
for art enjoyment and appreciation of form, line, 
color, and texture, which may be realized through 
observation and manipulation. Either manipula- 
tion or observation provides real art experience 
which is vital and functional because of a felt 
need, recognized through personal contact by the 
individual with an actual art situation. 

The assumptions basic to this investigation 
are as follows: 


1. Certain experiences in the learning situa- 
tion are more meaningful to the individual 
than others, because, 

a. Where a certain commonality of exper- 
ience exists, these appear to be more 
naturally within the experience of the 
individual}. 

. The ‘doing’ is intriguing and interest- 
ing. 

. These experiences are in harmony with 
professed beliefs. 

. These experiences appear to offer the 
greatest potentialities for progress to- 
ward recognized goals. 


. In the process of evaluation a more valid 
judgment can be secured on the total worth 
of a drawing when attention is focused on 
a composite, rather than on isolated parts. 


. Each drawing must be regarded as an arti- 
ficial form, since it is a graphic two di- 
mensional interpretation of an individual 
experience. 


The problems to be faced in the investigation, 
and the related assumptions suggest the follow- 
ing hypotheses: 


1. For the maximum results from a problem 
Situation, one must have the resources for cop- 
ing with the situation at hand. 

2. It is important for the individual, espec- 
ially where sensory cues are utilized, torespond 
to the total situation, not to items of fragmentary 
nature. 


Individuals were informed prior to making the 
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drawings that these three questions would be asked 
of each drawing: 


1. Are the forms clearly presented? 

2. Does the drawing convey a message? 

3. Do all parts function to give unity to the 
drawing? 


The source, process of refinement, and validation 
of these statements of criteria are described in 
detail in Part A, Section II. In terms of the stu- 
dent making the drawing, the criteria were thought 
to be most functional in question form. 

The evaluation of individual drawings was done 
by a jury of five college teachers in Art Education. 
Each member of the jury, working on all drawings 
of a single action theme, evaluated each drawing 
on its total merit. In making this evaluation the 
judges were aware of the criteria used by the stu- 
dents, but each was asked to use his own personal 
criteria of what constitutes merit in a drawing. 
These personal statements of criteria were sub- 
mitted to the investigator, and are listed in Part 
A, Section Il. Except for knowing that all draw- 
ings judged in a series were made by members 
of one class, the members of the jury were not 
informed as to the identity of individuals who made 
the drawings, or the conditions under which the 
drawings were made. A committee of five instruc- 
tors in Art Education at the University of Wiscon- 
sin served as the jury that evaluated the drawings 
in this investigation. 

To establish the reliability of the evaluation of 
drawings, the judges re-evaluated one complete 
action theme after a two month time interval. 

A functional curriculum in the modern school 
has no place for Art as an isolated subject, or for 
any subject which attempts to exist as an entity in- 
dependent of life. One criterion of the effective- 
ness of a subject area such as Art is the extent to 
which activities and experiences are tied to every- 
day life. Art has been defined in many ways, and 
any definition, to be acceptable, must serve our 
contemporary society. The breadth of Art, and 
the necessity for its application are emphasized 
by Haggerty** in his definition of Art, which is as 
follows: 


The outward activities and inward ex- 
periences that are called art are the ef- 
forts of human beings to make life more 
interesting and more pleasing. Art ob- 
jects which are the product of these ac- 
tivities and experiences are meaningful 
to the degree that they increase human 
enjoyment. 





* Cecelia L. Hawley, "Broadening Our Conceptions of Art Education," Education, LX (1939), ppe 134-137. 


* Melvin \/. 





Haggerty, Art A Way of Life (IMinnmeaplis: University of linnesota Press, 1935). 
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That some experiences in Art Education are 
more valuable than others for the achievement 
of specific desired outcomes has been expressed 
by many writers in the field. However, there 
is little experimental evidence from investiga- 
tions where art experiences have been compared, 
to show definite statistical advantage of one type 
of art experience over another. 

A distinctive aspect of this investigaticn is 
that a problem was presented in each teaching sit- 
uation, and the individual had opportunity to re- 
spond with his total resources. As the learning 
experiences were set up, varying amounts of rel- 
evant subject matter were present in the three 
situations to increase the possibility of differ- 
ences in the drawings. This system of evalua- 
tion permitted a comparison of achievement for 
the three groups, on each of three action themes. 

An advocate of the type of creative expression 
where no sensory data is supplied, or of the mo- 
tion picture, or of the field trip may claim cer- 
tain benefits of his particular type of activity for 
the production of drawings with merit. This in- 
vestigation points out specifically the statistical 
achievement for each of the three art experiences, 
suggests advantages and disadvantages for each 
type of art experience, and offers areas for fur- 
ther investigation on this and related problems. 


SECTION II 
DESIGN OF THE INVESTIGATION 


A. Sources of Data 





THE GROUP making the drawings for this 
investigation consisted of 60 University of Wis- 
consin undergraduate students enrolled in three 
sections of the course offered in the Art Educa- 
tion Department entitled 50a (Basic Drawing). 
The course description for 50a, as stated in the 
University bulletin, is as follows: ‘‘Elementary 
principles of black and white media in study of 
still life and nature. Perspective and composi- 
tion. ’’ The course 50a is a required course for 
students who have Art Education or Applied Arts 
as a special field. For students specializing in 
other fields, 50a is an elective course. 

Supplementary information that helps to de - 
scribe the group was collected through the use 
of a combined data sheet and questionnaire for 
each individual. (A summary of the findings 
from this source is given in the section on find- 
ings, Section III. ) 

From class rosters of the three sections of 
50a, where the names of students appeared in 
the order that they had signed up for the course, 
on each of the three rosters the students were 
numbered consecutively as their names appeared, 





In this manner, each class was divided three ways, 
and three groups were organized. An individual 
assigned to a specific group, did all three draw- 
ing exercises in that group. The three groups re- 
sulting from this process were designated as fol- 
lows: Control Group, Experimental Group 1, and 
Experimental Group 2. 

Because of the manner in which the individuals 
were assigned to groups, plus the fact that each 
class was divided three ways, the assumption is 
made that this represents a random sample of the 
population that makes up the three sections of 50a. 
General makeup and characteristics of this group 
would allow the experimental findings to be applied 
widely to other groups. 

It was thought best to construct a few simple 
statements to act as criteria for the drawings. The 
reasons for having criteria of this kind are two: 1) 
Beyond the original instructions that are given, 
these simple statements will more clearly indicate 
to each student the purpose and direction of this 
study; 2) because of the individual criteria to be 
used by each judge in the evaluation process, these 
initial criteria will serve as a point of departure 
from which judgment can be made. 

The source, process of refinement, ‘and valida- 
tion for these criteria for the drawings is as fol- 
lows: 1) Published materials in art education were 
consulted, including books, magazines, and period- 
icals, with special emphasis upon works most re- 
cently published. It seemed desirable to have 
simple statements that would be readily understood, 
general, yet applicable to this problem. 2) The re- 
sulting criteria were presented at a meeting where 
the teachers of the three drawing classes were 
present, and also the Chairman of the Art Education 
Department. Discussion of these statements of 
criteria led to further refinement and final crystal- 
lization in question form. 3) The three statements 
of criteria were accepted as valid for purposes of 
this investigation by the five members of the evalu- 
ation jury, at a preliminary meeting, held two weeks 
before the first evaluation of drawings was made. 

4) Comparison of the three statements of criteria 
with the individual statements of criteria submitted 
by the five judges reveal no sharp conflicts. 

Two weeks before the first evaluation of draw- 
ings was made the judges agreed to submit a series 
of statements that would outline each judge’s con- 
cept of ‘what constitutes merit in a drawing?’ Since 
the judges preferred to do this in individual confer- 
ences, the investigator held individual conferences 
with each judge, wrote up the statements of criteria 
arrived at in the interview, and submitted this to 
each judge for possible changes or revisions. After 
the necessary changes and revisions, the individual 
criteria of the judges were in final form. While 
there is no detailed analysis intended within the 
province of this investigation, the things most com- 
monly stressed as qualities of a good drawing (men- 
tioned by two or more judges) appear to be: sound 
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organization, individual technique, interesting 
presentation of elements, careful rendering, 
space filling quality, ideas expressed readily, 
clear and articulxte expression, sincere subjec- 
tive presentation. Things that evidently detract 
from the merit of a drawing, according to these 
five judges, are: the inclusion of meaningless 
material, inadequate understanding of subject 
matter, inadequate grasp of line and perspec- ~ 
tive, lack of strength of line, evidence of im- - 
posed technique, nd lack of total integrity. In 
listing the individijal criteria, and throughout 
this report, the five judges will be identifiedas 
A, B, C, D, and %. 


Personal Cjiteria of Judge A 


. The essential «giality of the drawing, or, de- 
sign for its ab:$ract quality. 

. Sound organizi#ion or structure, with ele- 
ments present.gi in an interesting way. 

. Sensitivity of i@e line itself, with recogniza- 
bility a purely grbitrary characteristic. 

. Careful rende#:g, plus space filling quality. 

. An individual ‘@hnique peculiar to the stu- 
dent at his sta, of development. 

. Strength of lin4 ndicates that the student 
knows himseli @ vith no imposed technique 
in evidence. 


Personal @ iteria of Judge B 


. Ease of pictor)@ structure 
a. The drawin;@ hould be designed for the 
whole space 
. Ideas visualize @ readily 
1d should not obviously be 
1and sources. 

b. Direct expeig@:nce results in richer visual 
conception inga drawing, than vicarious 
experience. 

. Ease of repres«lation of objects 

a. There shoulcibe evidence of individual in- 
ventive capacity in the drawing. 

b. Pictorial.organization is one of the most 
difficult things to learn, but is important 
in the evaluation of a drawing. 


Personal Criteria of Judge C 


. Expression shouid be clear and articulate, 
with a distinct transmission of ideas. 

. Drawing should show a wise use of the med- 
iunis as well as control of technique. 

. Essential elements of the drawing should 
evidence a departure from general concept, 
and should seek out the unique aspects of the 
subject. 

. Subjective presentation should be sincere. 

. Accuracy of perception is important in the 
drawing process and a clear understanding 





of natural form provides a strong resource for 
imaginative pictorial construction. 

. It is important to consider the total integrity of 
the picture, hence, it is important to develop 
certain devices to bring about a resolution of 
the pictorial forces, giving a sense of complete- 
ness, even if just by implication. 


Personal Criteria of Judge D 


. All elements of a drawing should function. 

.. Since the passive or undesirable detracts from 
the total merit of a drawing, the drawing should 
have no meaningless or irrelevant material. 

. All elements of the drawing should have clarity 
of presentation. 

. Recognizability with precision is an important 
quality, although distortion (as long as the pre- 
ceding is retained) is the prerogative of the 
artist. 

. The drawing should present ideas in such a way 
that there is no groping on the part of the alert 
observer. 

. Subject matter of a drawing should be presented 
in a manner which indicates that the subject mat- 
ter has complete meaning for, or is thoroughly 
understood by the individual. 


Personal Criteria of Judge E 


. Form 
a. Treatment of the drawing as a unit through 
a sound overall design, balance, and care- 
ful placement of objects. 
b. A quality of line which gets the most out of 
the medium used, and a variety of textures. 
c. Evidence of a correct knowledge and wise 
use of linear and atmospheric perspective. 
. Concept 
a. An individual concept, and a complete aware- 
ness of the concept. 
. Sensibility 
a. A feeling put across by the drawing that in- 
dicates a personal experience with, anda 
personal feeling about the subject portrayed. 


Drawing materials used in the investigation in- 
cluded soft black pencils (General Carbo-Weld Ex- 
ercise, no. 931) and good quality heavy white draw- 
ing paper, size 18 x 24 inches. Each student fur- 
nished his own drawing board. 


B. Procedure in Collecting Data 





Descriptions of Three Types of Learning Exercises 





Control Group. —lIn the classroom environment 
this group was given the action theme, and allowed 
to draw for 30 to 45 minutes, then the drawings 
were collected. The three action themes were as 
follows: 
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‘Fire Engines Going to a Fire’’ 
‘‘Activity in the Lion Cage ’’ 
‘*Active Children in a Country School’’ 


Experimental Group 1. —In the classroom en- 
vironment this group was given the action theme, 
shown a sound color film that featured subject 
matter in varying amounts pertaining to the ac- 
tion theme, then allowed to draw immediately 
after seeing the film, for 30 to 45 minutes, then 
the drawings were collected. On theme 1, the 
film ‘‘Fire Engines’’ was shown. This film has 
the locale of a big city fire station, shows the 
routine life of a fireman working around the fire 
engines. The action of each division of the fire 
company is portrayed, when the alarm is sound- 
ed and they go to the fire. There is quiteastrong 
emotional impact from the nature of the subject 
matter, and the vivid action portrayed. Therun- 
ning time on this film is 11 minutes. On theme 
2 the film ‘‘The Zoo’’ was shown, also an 11 
minute film. Although many animals are featured 
a large part of the film is concerned with lions. 
While this film does not have as much emotional 
impact as the previous one, the subject matter 
is interesting, and has appeal to human nature. 
On theme 3 the film ‘‘Schoolhouse in the Red’’ 
there is an emotional effect, due to the strong 
story concerned with consolidation of rural schools. 


However, of more immediate use for a drawing 
on this theme is the part which shows a smallone 
room country school with typical action in and 


outside the school. 
is 45 minutes. 
Experimental Group 2. —After assembling at 
a prearranged starting point the students were 
taken by cars to the particular field trip destina- 
tion. Upon arriving at the field trip destination 
the students were given the action theme that they 
would interpret in a drawing. Each field trip sit- 
uation was different, as explained in a brief dis- 
cussion of each that follows, but in each field sit- 
uation students were allowed to draw from 30 to 
45 minutes in that environment, and the drawings 
collected. The field trip concerned with theme 
1 was to the Main Fire Station, Madison, Wiscon- 
sin. A captain in the fire department met the 
group, and led a conducted tour, lasting about 30 
minutes, through the fire station. Verbal descrip- 
tions, and actual demonstrations were included, 
with opportunity for questions by the students. 
The students were then allowed free run of the 
station to select whatever subject matter they 
wished to include in the drawings. The field 
trip concerned with theme 2 was to the lion house 
of the Vilas Park Zoo, Madison, Wisconsin. A 
zoo attendant was present to point out charac- 
teristics and eating habits of the lions, and to 
answer any questions. The field trip was held 
at a time when the lions were inclined to be more 
active, and moving around. The students could 


The running time on this film 
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use whatever sensory material they found in that 
field trip situation, in their drawings. The field 
trip concerned with theme 3 was taken to the Cat- 
fish Rural School, Dane County, Wisconsin. This 
is a large one-room rural school located about 
six miles north of Madison, just off highway 113. . 
Students were taken to this school while the school 
was in session, allowed to observe, and make 
drawings there while the school activities were go- 
ing on. Part of the school room activity included 
organized classwork, part of it included recess, 
where some of the pupils chose to watch the draw- 
ings being made. The school teacher was available 
for questions, and the students talked freely with 
her. Again, the students were free to use whatever 
sensory materials they wished, in their drawings. 


General Instructions to All Students Making Draw- 
ings 





Since three classes were used, the general in- 
structions had to be given three times, in each of 
three classroom situations. After the investigator 
had been introduced, the title and purpose of the 
investigation were given. The setup of three par- 
allel groups was explained, along with explanation 
and example of the type of thing done in each group. 
That assignment to groups would be done on a ran- 
dom, impartial basis was brought out, besides the 
fact that once assigned, a person would make three 
drawings in that same group. The three statements 
that were to serve as criteria for the drawings were 
presented, with opportunity for questions on any 
part of the explanation. The fact that the drawings 
would be put together for the evaluation was pointed 
out, and that the evaluation jury consisted of five 
college art teachers, each using his own criteria 
in the process. The students were informed that 
they would not be graded on this, except as their 
work counted toward daily class work. The stu- 
dents were informed as to the type of materials 
that would be used, that except for supplying their 
own drawing boards, all materials would be furn- 
ished. An attempt was made to keep all explana- 
tions to all three classes as uniform as possible; 
however, the above information was regarded as 
essential, so none was omitted. 


Evaluation of Drawings 





After all the drawings had been collected they 
were put into three groups according to the action 
theme, making 60 drawings each on three themes. 
Since the students’ names were on the back, an 
identifying three digit number was the only identi- 
fying mark on the front side. This number was 
placed in the upper right hand corner, in black in- 
dia ink, with the number 3/4 inches high. Since 
these numbers were not assigned in any logical 
sequence to represent groups, when displayed they 
ran clockwise around the room, from the smallest 
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to the largest number. 

For the first evaluation, three sets of 60 
drawings were hung in two rows, at near eye 
level in three unused classrooms, one large, and 
two smaller rooms. Prior to hanging the draw- 
ings, all windows had been covered with brown 
paper (to admit no light, since evaluation was 
done in the daylight hours) and the electric light 
was equally strong on all drawings. Each judge 
worked independently, with the help of the inves- 
tigator to mark his choices as they were made. 
One complete theme was judged at a time, with 
one evaluation sheet for each of the three action 
themes. 

Reference is made here to the sample evalu- 
ation sheet, or scoring sheet, in the appendix, * 
and included here. This evaluation sheet has 
spaces in which numbers of individual drawings 
are to be placed. On the left hand side of the 
sheet there are four blocks of spaces, each in- 
cluding spaces for 15 numbers. The caption 
under each block is self-explanatory, but by fill- 
ing every space the number of every drawing of 
the total 60 will be there. The spaces onthe 
right hand side are for the ten best drawings in 
the upper right, and the ten poorest drawings in 
the lower right. The criteria that the students 
had when the drawings were made were printed 
on this sheet for the convenience of the judges. 
There was no specified order in which this eval- 
uation sheet was to be filled out. However, the 
most common procedure was as follows: (All 
drawings were in plain view at alltimes.) 1) The 
best 15 drawings were selected, the numbers 
marked down in the ‘first quartile’ block, anda 
small colored identification tag placed in the 
corner of the 15 selected drawings. 2) From the 
15 marked drawings, the two best drawings were 
selected, the numbers put in the two spaces in 
the upper right. 3) From the remaining 13 marked 
drawings the 8 best were selected, numbers 
marked in the block of 8 spaces in the upper 
right. 4) To the other extreme, the 15 poorest 
drawings of the entire 60 were selected, numbers 
marked in the spaces of the ‘fourth quartile’, 
and these 15 drawings marked with a different 
colored tag, for identification. 5) From the 15 
drawings marked by the 2nd color, the two poor- 
est drawings were selected, numbers marked in 
the spaces for the two poorest in the lower right. 
6) From the remaining 13 drawings in this group 
the 8 poorest were selected, numbers put in the 
block of 8 spaces in the lower right. 17) From the 
remaining 30 unmarked drawings, the 15 best 
were selected, and the numbers marked down in 
the ‘second quartile’ block of 15 spaces. 8) Since 
all 60 are to be represented on this sheet, the 
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investigator was able to fill in the 15 spaces re- 
maining, in the ‘third quartile’ block. After one 
complete action theme had been judged, all colored 
tags were removed, before the next judge began 
his evaluation. After all five judges had evaluated 
the three action themes of 60 drawings each, the 
drawings were taken down. 

At the time of the first evaluation of all draw- 
ings (180) the judges knew that they would be asked 
to make another evaluation of one complete action 
theme (60 drawings) after a two month time lapse, 
but the judges did not know which of the three ac- 
tion themes would be the one selected for reevalu- 
ation. By a system of random selection, theme 1 
(‘‘Fire Engines Going to a Fire’’) was the one se- 
lected for the second evaluation. Before these 
drawings were hung for the second evaluation the 
numbers were changed to two digit numbers, 3/4 
inches and located in the upper right corner. The 
reason for changing the numbers was that if visual 
memory persisted from one evaluation to the next, 
it would be of the drawings themselves, and not in 
the way they were identified by number. 

For the second evaluation, two months after the 
first evaluation was made, the drawings were dis- 
played in the same large classroom that had been 
used previously. The same precautions were taken 
here to insure adequate even lighting on all draw- 
ings, as had been taken in the first evaluation, and 
the drawings were hung at near eye level, intwo 
rows. Since the numbers assigned in this second 
instance had been done with no logical sequence to 
represent groups, when displayed, they ran clock- 
wise around the room, from the smallest to the 
largest number. Judges worked independently as 
before, with the investigator present to put tags on 
the drawings as they were selected. The same 
score sheet, or evaluation sheet, was used here, 
as in the first evaluation, with same procedure of 
selection that has been described. After each judge 
finished his evaluation of the 60 ¢rawings on this 
action theme, the identification tags were removed, 
to eliminate the possibility of one person’s judg- 
ments influencing another’s judgment. Withthis 
phase of the evaluation finished, each of the five 
judges had evaluated themes 1, 2, and 3 in thefirst 
evaluation, and theme 1 two months later in the 
second evaluation. 

At this point in the procedure the evaluation data 
consisted of twenty evaluation sheets, each contain- 
ing eighty filled spaces. For convenience in hand- 
ling, the drawings were renumbered 1 through 60, 
and former numbers transposed to twenty new 
evaluation sheets, where numbers 1 through 20 
were drawings made by the Control Group; 21 
through 40 the Experimental Group 1; and 41 through 
60 the Experimental Group 2. 





* All references to Appendices may be found in original thesis on file in Library, University of 
Wisconsin, Madison, Wisconsin. 
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Evaluation of Drawings 























od 


From list Quartile, The Two Best 


First Quartile - The Best Fifteen Drawings ; 






































(No particular order in this group) 




















From Remaining 13 of the 1st Quartile 
Select the Eight Best Drawings 
(No particular order in this group) 





The following questions were pre- 
sented as criteria to act as directional 
guides for individual drawings: 








1. Are the forms clearly presented? 




















2. Does the drawing convey a message? 





Second Quartile - 2nd Best Fifteen Drawings 3. Do all parts function to give unity 
to the drawing? 



































Third Quartile - 3rd Best Fifteen Drawings 
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From 4th Quartile, The Two Poorest 















































Fourth Quartile - 4th Best Fifteen Drawings 




















From Remaining 13 of the 4th Quartile 
Select the eight Poorest Drawings. 
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With a total of 60 drawings on eachaction 
theme, division of the 60 into quartiles gives an 
even 15 in each quartile. With the evaluation 
sheet used, it may be obvious that the numbers 
arrange themselves from one extreme to the 
other as follows: 2, 8, 20, 20, 8, 2, whichtotal 
60, but follow the normal probability curve. Since 
the score sheet, or evaluation sheet is set up on 
this basis, it is a simple matter to assignscores 
1 through 6 on the basis of these 6 levels. Ac- 
cordiig to this plan, only two scores out of the 
60 can have the value of 6, the highest score; 
only two scores can have the value of 1, the low- 
est score, etc. From the twenty evaluation 
sheets which numbered the drawings from 1 
through 60, the table of raw data was compiled 
as a summary of all evaluations made by the 
judges. It may be pointed out here that the 2, 8, 
20, 20, 8, 2 correspond roughly to the following 
percents that go to make up the normal probabil- 
ity curve, 4, 13, 33, 33, 13, 4, totalling 100%. 
Although there are six resulting levels, these 
are in no way meant to represent grades, but 
merely levels of performance. When a jury has 
to select 20 paintings to hang in a given space 
from 100 submitted, the process is simply one 
of selection of the best 20, for example. In a 
parallel situation, when a judge has to select the 
15 best drawings from the total number of 60, it 
eliminates the other 45 from consideration at 
that stage. 


C. Treatment of Data 





Controls were employed in the investigation 
as follows: 


1. Each person in these three drawing classes 
had the same chance for random assign- 
ment to each of the three groups. 


. Regardless of group each person had the 
same three action themes. 


. Regardless of group each person had the 
same time limit on drawings. 


. Regardless of group, each person used 
the same materials, black drawing pencil, 
and white drawing paper. 


. Regardless of group, each person had the 
same general instructions and explanation. 


. Since each of the three classes were divid 
ed three ways, the differences between 
classes was minimized. 


. Regardless of group, each person had the 
same three criteria for the drawings. 
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8. The same five judges made evaluations on 
the drawings of all the students in the in- 
vestigation. 


9. The information requested on the individual 
questionnaire and data was the same for all. 


10. Regardless of group, each person had to 
make drawings on three different days, and 
time allotment was the same for all. 


The process of evaluation assigns a level of 
achievement to each drawing, on every actiontheme. 
As discussed in the description of the procedure in 
Part B, just preceding this part, the numbers of 
specific drawings were transposed into numbers on 
the scale 1 through 6, with 6 being the high end of 
the scale. The resulting table of raw data was used 
for the basis of all statistical computation by which 
comparisons and contrasts are shown. This table 
of raw data is located in the appendix (found in the 
original thesis), and will be referred to often in 
the discussion of how the data was treated. 

At an early atage the analysis of variance tech- 
nique was employed using the means of the three 
groups on each of three action themes. Intable 
form, three means can be averaged on each group, 
and a grand mean calculated. Using the formula 
found on page 336 of Alexander M. Mood’s Intro- 
duction to the Theory of Statistics, the analysis of 
variance problem was worked out. This formula 
is given on the next page. 

The question to be answered in this process was, 
‘‘Does the among variance exceed the within vari- 
ance by an amount that is statistically significant?”’ 

At another stage, ‘‘Students T’’ scores were 
calculated to test the significance of differences 
between the mean achievement of various groups 
under different conditions. ‘‘Students T’’ scores 
were worked out for the second evaluation of theme 
1, in addition to the regular evaluations of themes 
1, 2, and3. To determine what the probabilities 
that the differences were large enough to have oc- 
cured by chance, the table on distribution of the 
‘‘Students T’’ was consulted. By this method, the 
level of probability for each score was determined. 

As a check on the calculations concerned with 
the ‘‘Students T’’ critical ratios were calculated on 
the second evaluation of theme 1, besides the reg- 
ular evaluations of themes 1, 2, and3. The form- 
ula used in calculation of ‘‘Students T’’ was as 
follows: 





a) a 


x 
| a. oa. 
N-1 


The formula used in the calculation of the critical 
ratios was as follows: 


Diff. (means) 
o Diff. 
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Source Sum of Squares 


LOOMER 


Degrees of 


Freedom Mean Square 





Row 


mc} (xj - x)* =S, 

Column at (x; - x)? =S, 

Interaction mz (Xjj - Xj - Xj + x)? = S, 
1) 


Deviations 


x (xijk - Xi)? =S 
ijk ijk ij) 4 


Total D (xii, - x)? 
ij “tik x) 


Ss 
iin, ts 
r-1 Si 


fat 


Ss 
Sa -. 
c-1 Sa 


S 
(-iye-1) >? 


re(m - 1) ec iy > S, 


c-1 


(r - 1)(c - 1) 


se aE 





k = groups, m= cases, i = individuals, j = columns 


The level of probability of critical ratios was de- 
termined, as had been done for the ‘‘Students T’’ 
score. 

A further check on the differences in achieve- 
ment of the three different groups was made by 
calculation of critical ratios, using the same 
formula for critical ratio as shown above. The 
level of probability for these critical ratios was 
determined. As a method of checking this work, 
‘‘Students T’’ scores were calculated by the use 
of the same formula for ‘‘Students T’’ as shown 
above. 

The extent of agreement of judges was stud- 
ied by calculation of the coefficient of correla~ 
tion of every judge with every other judge oneach 
of three action themes in the regular evaluation. 
As a result of this process, 30 coefficients of 
correlation were calculated. This also made 
possible the calculation of a median coefficient 
of correlation for all judges on each of three ac- 
tion themes. 

The extent of reliability of evaluation was de- 
termined by two methods: the first established 
the extent of agreement between two judgments 
of one person, as expressed in a coefficient of 
correlation for each of three groups. The form- 
ula used in the calculation of these coefficients 
of correlation was as follows: 


xy - (2x - Y) 
Vv (x? - Dx. x)(y? -Zy-~ y) 








In the first instance five coefficients of correla- 
tion resulted, one for each judge. In the second 
instance, three coefficients of correlation result- 
ed, one for each group, X, Y, and Z. All coef- 
ficients of correlation were calculated on the 
first and second evaluations of action theme 1. 





If the reliability of an investigation such as this 
were to be based primarily on the agreement of 
one person’s first and second judgments, this meth- 
od is proposed as one which would increase the 
extent of reliability: Evaluations of the three judges 
having the highest coefficient of correlation be- 
tween their two evaluations were averaged, then 
by the use of the same formula as that used above, 
the coefficient of correlation was calculated be- 
tween the highest and the lowest group of judges. 
(The lowest group in this case would consist of 
two judges, whose two evaluations could also be 
averaged.) The resulting coefficient of correla- 
tion between the two groups would indicate whether 
the results would have been significantly different 
if onJy three, instead of five, judges would have 
been consulted. 

How the accumulated data has been treated has 
been indicated. The findings from the treatment 
of this data will be listed in Part A of Section III; 
Part B of Section I will describe the group, ac- 
cording to the results of the individual data sheet 
and questionnaire; Part C of Section III will com- 
pare group accomplishment, and through the dis- 
cussion will interpret the findings to the end that 
the findings support the inferences made, and 
lead to the conclusions of the investigation. 


SECTION If 
STATISTICAL ANALYSIS OF FINDINGS 


A. Statistical Findings 





THE RAW data gatheredfrom sources 
indicated in Part A of Section I, and treated as 
described in Part C of Section II will be present- 
ed in this section under the following headings: 
1) Analysis of Variance, 2) Variance Between 
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Groups, 3) Group Accomplishment by ‘‘Students Groups. In some instances the analysis has re- 
T’’ and Critical Ratio, 4) Agreement of Judges, sulted in the findings presented here; insome 
5) Agreement Between ‘Most Reliable’ and ‘Least instances additional comment is included in this 
Reliable’ Judges, 6) Reliability of Performance section, and in Part C of this section to further 
by Judges, and 7) Reliability of Performance by analyze and interpret the findings. 


1. Analysis of Variance: 


Degrees of 
Source Freedom 





Row* 2 
Column** . 00 2 
Interaction 2.044 4 
Deviation 98.21 171 


Total 105. 054 179 





* This represents the three different groups: Control, Experimental 1, and 


Experimental 2. 
** This represents the three action themes, 1, 2, and 3. 
***In the ‘‘F Test’’ this amount is significant at the . 05 level. 


2. Variance Between Groups: 


Critical Ratio ‘Students T’’ 


X to Y (Control to Experimental 1) 1. 76 
X to Z (Control to Experimental 2) 1,27 
Y to Z (Experimental 1 to Experimental 2) 2. 84* 


*Significant at the . 01 level. 


3. Comparison of Group Accomplishment: 


Critical 
Comparison ‘“‘Students T”’ Ratio Direction 





Action Theme 1 X to Y . 567 . 567 
X to Z . 088 . 088 
Y to Z . 702 . 702 


Action Theme la X to Y . 707 . 107 
X to Z . 758 . 760 
Y toZ . 439 . 444 


Action Theme 2 Xto Y . 981 . 981 
X to Z . 115* . 105 
Y toZ .911** .911 


Action Theme 3 X to Y . 509 . 500 
X to Z . 078 O77 
Y to Z oT .317 


NNSM NNS® NNK NN 


* Significant at the . 05 level. 
**Significant at the .01 level. 
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4. Agreement of Judges: 


Judges agree to the extent shown by the following coefficients of correlation, on evaluation of all 60 


drawings of the three action themes: 


Theme 1 


.24 
. 32 
. 48 
-1l 
. 44 
. 42 
.17 
. 42 
i 
.27 


Median scores for the three themes are as 
follows: 


Theme 1 
Theme 2 
Theme 3 


. 295 (Interpolated) 
. 305 (Interpolated) 
44 (Interpolated) 


5. Agreement Between ‘Most Reliable’ and ‘Least 
Reliable’ Judges: 


On the basis of each judge’s coefficient of cor- 
relation between his two evaluations (shown in 
part 6 immediately following), the five judges 
were assigned to two groups: Most reliable, the 
ones with the three highest coefficients of correl- 
ation between their own two evaluations of action 
theme 1, and Least reliable, the two with the low- 
est coefficients of correlation. The evaluations 
are averaged for each group, and the coefficient 
of correlation between groups calculated using 
the same formula as before. Group ACD to BE 
gave a coefficient of . 46. 


6. Reliability of Performance by Judges: 


On two evaluations of one complete action 
theme (60 drawings), with a two months time 
lapse between evaluations made by the same judge, 
the following coefficients of correlation were cal- 
culated: 


Judge A . 72 
Judge B . 56 
Judge C . 83 
Judge D . 80 
Judge E . 37 


7. Reliability of Performance by Groups: 


On one complete action theme (60 drawings) 
that was evaluated twice, with a two months time 





Theme 2 Theme 3 


lapse, the ratings of five judges were averaged 
and the coefficients of correlation were calcula- 
ted for the three groups X, Y, and Z. 


X to X' (Control Group) . 16 
Y to Y' (Experimental Group 1) . 90 
Z to Z' (Experimental Group 2) .91 


B. Summary of Individual Data Sheet and Ques-~ 
tionnaire 





Reference is made here to the sample individ- 
ual data sheet and questionnaire in the Appendix 
and found on page 79 of this study. The purpose 
of this data sheet was to supply important infor- 
mation on each student relative to this background, 
training, experience, and co-curricular activities; 
to provide information about the extent of contact 
with subject matter of the action themes used in 
this investigation; and to allow each student the 
opportunity to express his opinion about the out- 
comes of this study, and to indicate his interests 
in particular aspects of the material used. 

Since these data sheets were filled out in the 
classroom after all drawings had been completed, 
the students were in a position to express them- 
selves. Students were encouraged to add any ad- 
ditional comment that they wished, which many 
chose to do. There was 100% return on these 
data sheets, so that a complete account is avail- 
able. 

The summary of all compiled information is 
shown in table form on the following pages, the 
total information is listed in the first column, 
with the breakdown according to the three groups 
that featured different art experiences. 

With opportunity to describe one’s own style 
of drawing, the most common descriptive terms 
include such things as: ‘none developed yet, ’ 
sketchy, exact, loose, detailed, childish, inde- 
scribable, cartoon, coarse lines, ‘don’t know, ’ 
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SUMMARY TABLE 


Experi- Experi- 
mental mental 
Control 1 


Classification Freshmen 10 1 





Sophomores 
Juniors 
Seniors 


4 
4 
2 


Home Address Madison, Wisconsin 
Within Wisconsin 
Out of State 


Subject Area Applied Art 
Art Education 
Other Subject Areas 


Number of College Art 
Courses 


Semesters of High 
School Art 


Dawe wortorow 
—FK OF OCOWr Oe & 
KoOooocoocorRNnNrNd 


0 
1 
2 
3 
4 
5 
6 
7 
8 
2 


= 


Number Having 1 year or less 
Private Art 1 - 2 years 
Instruction Over 2 years 


> 
oro 


Number of Visits to 0 
Fire Station Since 1 
Starting High School 2 

3 


5 
10 
500 


COronnNOA 


Number Who Have Never 
Visited a Fire Station 


nN 
i) 
© 
— 
oO 
w 


Number of Visits to Lion 
House of a Zoo Since 
Starting High School 


Ao ues. one © 
onNnNN PHONO UI 
CONF NW OW 
ocor kh BR WOr 
ON ON WOUN 
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Experi- Experi- 
mental mental 
Total Control l 2 


Number Who Have 
Never Visited the 
Lion House at a Zoo 


Number of Persons 
Who have Attended a 
Country School 


Years Attended ina 
Country School 


Opinion of 45 Not adequate 
Minutes as O. K. for Sketch 
a Time Plenty of Time 
Limit? No Opinion 


Group Pre- 
ferred if Control Group 
Study were Experimental Group 1 
Repeated? Experimental Group 2 


Which Group’ Control Group 
Do You Think Experimental Group 1 
Excelled Experimental Group 2 
No opinion 


Reasons Given for Specific 
Group Preferred? 


A. Control Group 
Better to work from imagination 
Favors thinking out art organization 
Better for use of originality 
Better for creativeness 
More freedom in drawing 
Enjoys using imagination here 
Favors individual interpretation 
Easier, not so much to do 





— ee 
Or RK eK OF 
orocococcocr 
cococor WN’ 


. Experimental Group 1 
Presents most ideas, novel ways 
Time saving, no running around 
Experimentation, compare results 
Easy way to get ideas 
Interesting, permits use of imagination 
Movies are entertaining 
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C. Experimental Group 2 
More interesting from real life 
Something definite to look at 
Gives needed information here 
Easier tc .draw from actual object 
No need tg rely on memory 
Get around more to new locations 
Practice yaluable on the spot 
Get bette; action here 
Get more feeling here 

Np opinion 





On Which Theine 
Do You Thin} 
You Made thy 
Best Drawing? 

Reasons Why You Think 
that (Above) Drawing 
is Best? 


1 (Fire Engines) 
2 (Lion) 

3 (School) 

No Opinion 


5 


More inte gested 
No reaso:: 
Like actic} 
More acq: 
Easier to 
More unii@, organization 
Flexible, gree 

More acti: 

More hum 

More use }f imagination 
More valu4 and pattern 
Less com@ex 

More rela gation 
Fulfilled «}$signment 





Experi- Experi- 
mental mental 
Control 1 2 





ee KH OOK OrF WN 
cocooconohr 
cocoOorrFON.Y Fe © 


ee 
— ee Oc 
ons @ 


_ 
coon. 


pet pes bet et mt es BD 69 69 93 CO OOO 
CoOrrR Kr OOF OCOKWWU Se 


Cr ooCocooOoNNwouwwr 
KOoooocoonrohonr & 





or ‘enjoy expr:}sion.’ Many students responded 
to this item in 4 manner that indicated that they 

expected this ait course and others to help them 
‘develop’ a sty’? in the course of their education. 
Reference to th@ results obtained through the use 
of the individu: j data sheet will also be referred 

to in Part C thi follows, in the analysis of group 
accomplishmer§. 


C. Analysis of $roup Accomplishment 








Where grou;:faccomplishment was compared 
on each of the t#ree action themes, plus the sec- 
ond evaluation «4 theme 1, the accomplishment 
of Experimenta‘4Group 2 (Z group, or the Field 
Trip group) wasjgreater in every instance when 
compared with the other two groups. When com- 





pared with the control group (X group, or Creat- 
ing on a theme with no provided sensory mater- 
ial) the Z group had the advantage in allfour com- 
parisons, but in no instance was the amount great 
enough to be statistically significant. When com- 
pared with Experimental Group 1 (sound-color 
movie group, Y group) the Z group had the advan- 
tage in all four comparisons, but only on theme 

2 was the amount statistically significant, on the 
.01 level. When groups X and Y were compared, 
group X had the advantage in all four compari- 
sons, but only on theme 2 was the amount statis- 
tically significant, on the . 05 level. 

When the reliability of performance by groups 
was checked on 60 drawings of theme 1, which 
was judged twice by five judges, there were slight 
differences in the stability of groups, Z group 
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Individual Data Sheet and Questionnaire 





Name Classification Fr. Soph. 





Home Address _ Major Subject Area _ 





Please fill out this data sheet and questionnaire, answering every item 
to the best of your ability. The investigator had no official relationship to 
any teacher who participated in this study. When completed, hand this in 
to your instructor. 


Write names and course numbers of all art courses you have had on the college level: 





How many semesters of art instruction did you have in high school? 


Have you had any private art instruction? (check one) Yess No __ 
If yes, (above) explain: 





Listed here are the three action __‘‘Activity in the Lion Cage. ”’ 
themes used in this experiment: ‘‘Fire Engines Going to a Fire. ”’ 
____ **Active Children in a Country School, ”’ 


1. Check the theme on which you think you made the best drawing (above). 


Why? (above) 


. Have you ever visited the lion house or zoo? Yes___—‘No_ 


Approximately how many times since you started high school? 
. Have you ever visited a fire station? Yes =» No___ 


Approximately how many times since you started high school? _ 


. Have you ever attended a country school? Yes__—s«— No 


If yes, for how many years? 





Listed here are the three __a. “Control Group”’ 


(Drew on the theme only) 
groups used in the b. ‘‘Experimental Group 1’’ (Drew after sound color film) 


experiment: c. ‘*Experimental Group 2’’ (Drew while on a field trip) 
5. Check the group in which you did your drawing (above). 
6. What do you think of 45 minutes asatime limit? 


7. Which group would you prefer if the study were repeated? a._ 


Why? (above) 





. As a group, which group will do best in final evaluation? a. _ 


. How would you describe your particular ‘‘style’’ or manner of drawing ?_ 
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having .01 higher reliability coefficient than Y 
group, and . 15 higher than X group. While the 
difference between Y and Z is negligible, the in- 
dication toward instability by X group may be be- 
cause the positive qualities such as originality, 
creativenes:;, spontaneity, and freedom of expres- 
sion believed by many to accompany the type of 
art experience to which group X had exposure, 
appear to ‘scatter’ that group in a situation where 
comparative evaluation is used. 

On the two evaluations of theme 1, it is inter- 
esting to note that when groups X and Y are com- 
pared, group X gained . 30 over group Y by the 
second evaluation. Group Z gained .67 over 
X, and the greatest gain was made by group Z 
over group Y, .91. Some drawings have quali- 
ties that ‘wear well’ while others may have ap- 
peal that is fleeting. Perhaps the art experience 
has a contribution to make in determining the 
‘lasting’ qualities of a drawing created in that 
environment. 

If recent experience with the subject matter 
of the action themes were important (the effect 
of this experience on drawings by individuals) ap- 
parent advantage for groups would be as follows: 
As reported by the individual data sheet Z group 
has had slightly more experience with the subject 
matter of theme 1, and groups X and Y about the 
same. With the subject matter of theme 2, group 
X seems to have had slightly more experience, 
with groups Y and Z about the same. Withthe 
subject matter of theme 3, group Z seems to 
have quite a definite advantage, since the group 
as a whole has had a total of 27 years of attend- 
ance at a country school; group Y has had 16 
years; and group X seems at a disadvantage with 
only 2-1/2 years in all. 

Since the ‘‘Student T’’ scores and the critical 
ratios that were calculated showed Z group to be 
superior in every instance where compared to 
groups X and Y, one might expect that chance as- 
signment had thrown more people into that group 
who had superior educational training and back- 
ground. However, the opposite seems to be true, 
according to the information supplied by the indi- 
vidual data sheets. In the number of art courses 
had in college, groups X and Z are about the same 
with group X having a slight advantage. Group X 
and Z have fewer people who are enrolled in an 
art curriculum, so Y group may appear to have 
an advantage here. While groups X and Y have 
5 people who have had private art instruction, 
group Z had only 1. With only 27 semesters of 
high school art had by group Z, group Y had al- 
most two times as much, and group X almost 
three times as much as that had by group Z. 

In summary, analyses of the findings show 
that there is a substantial difference in perform- 
ance by groups. Where groups are compared Z 
group is superior in every instance to X and Y. 
Where X and Y are compared X is superior in 
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every instance. Differences in performance are 
statistically significant in some instances at the 
.01 level, in some at the . 05 level, and in some 
instances are not large enough to be statistically 
significant. 

In the process of evaluation, the findings show 
that the agreement of judges, as shown by coef- 
ficients of correlation range from .11 to . 66, but 
that some judges agree to a greater extent than 
others. As shown by two judgments of the same 
material, with a two month time lapse, coeffic- 
ients of correlation range from .37 to .80. This 
would indicate that some judges are more reli- 
able than others, and also that judges agree ‘with 
themselves’ more than they agree with eachother. 

No attempt was made in this investigation to 
equate the three groups on the basis of curricu- 
lar or co-curricular training and experience, or 
past experience with subject matter of the three 
action themes. However, findings from the indi- 
vidual data sheet and questionnaire show a wide 
difference with individuals in the above areas. 
Information supplied through this avenue is valu- 
able in the extension and application of the find- 
ings of this investigation. 

Through an analysis of the drawings them - 
selves, many of the things brought out in the an- 
alysis of the findings will be graphically illustrat- 
ed. For that reason, a catalog of 36 selected 
drawings, with the written discussion included, 
will be presented in Section IV. 


SECTION IV 


COMPARATIVE STUDY OF INDIVIDUAL 
DRAWINGS 


A. Discussion of Drawing Qualities 





FROM THE 180 drawings that were made 
on three action themes, 31 have been chosen for 
special analysis. The first group chosen for con- 
sideration includes the three best drawings on 
each of the three action themes, as determined 
by the evaluation jury of five college art teachers. 
If terms taken from the criteria offered by the 
five judges themselves may be used to describe 
these drawings, they may be said to have such 
qualities as: clear and articulate expression, in- 
dividual technique, interesting presentation of 
elements, space filling quality, sound organiza- 
tion, careful rendering, sincere subjective pre- 
sentation, and ideas expressed readily. If the 
terms used by the students in describing the best 
drawings may be used, they may be expressedas: 
more interesting, more creative, and to possess 
more action, more unity and organization, more 
flexibility, more value and pattern, and more use 
of imagination. Of course, regardless of the 
terms chosen to describe a set of drawings, not 
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every drawing will be found to be equally strong 
in every quality listed. 

An examination of the numbers represented in 
the nine best drawings will reveal that seven are 
products of the Z group, one of the X group, and 
one of the Y group. It may be noted that student 
482 of Z group had drawings good enough to be 
rated in the top two out of 60 drawings on all three 
action themes. On theme 1, 2, and 3, student 482 
received ratings of 5, 5, 5, 5, 6; 4, 6, 6, 4, 5; 
and 4, 5, 6, 5, 3, respectively. (A rating of 6 
means one out of the two best in 60 drawings; 5 
means within the next eight best of 60 drawings, 
etc. ) 

One important advantage which the field trip 
would appear to have is illustrated by 482 ontheme 
1. The student who made this drawing positioned 
himself to the left rear of the large hook and lad- 
der truck in the fire station. With much of the 
sensory material there for reference, he built 
an interesting composition on the assigned action 
theme. Quite a contrast in draftsmanship is ev- 
ident in comparing 126 and 458 on the first action 
theme. However, where many qualities go to 
make up a good drawing, 126 apparently is judged 
superior on such qualities as sincerety of pre- 
sentation, total organization, or more adequate 
handling of the action theme. The novel viewpoint 
in 458 apparently has much to do with the success 
of the drawing, also, since originality and creat- 
iveness are important. In 928 the subject matter 
includes much detailed drawing which requires 
intense observation by the person in the fieldtrip 
situation; however, the detail is not allowed to 
become all important. In 745, in the drawing of 
the two lions, such things as simplicity and direct- 
ness of expressior. apparently compensate, to 
some extent, for the lack of a more detailed knowl- 
edge of the form, anda more sensitive line. In 
304, the schoolroom scene, there is a good illus- 
tration of how certain elements are stressed, and 
others played down, to achieve a total satisfying 
effect. One device used to direct attention to the 
form of the teacher, silhouetted in an action pose, 
is the convergence of lines toward that point. 

The nine drawings found to be poorest include 
six from group Y, two from group X, and one 
from group Z. Seven of the nine drawings judged 
to be poorest are shown here. If the negative 
terms from the criteria of the five judges may be 
used, the three poorest drawings on each of three 
themes may be described as poor in construction 
and organization, ideas often obviously from 
second-hand sources, little evidence of individu- 
al inventive capacity, insincere in presentation, 
including irrelevant and meaningless material, 
poor in balance, and lacking the variation in line 
and texture to make an interesting drawing. If 
we may describe the nine poorest drawings in 
terms used by the students in the individual data 
sheet, we might say that these drawings were 
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lacking in information, showed little imagination 
or originality, lacking in interest, uncertain and 
sketchy, and not enough life. 

From an examination of the numbers in this 
group, it will be noted that 736 appears in the 
poorest two on all of the three themes where 60 
drawings were evaluated. On themes 1, 2, and 
3 in order, 736 rated as follows: 3, 1, 3, 1, 3, 
and 1, 1, 1, 3, 3, and2, 1, 1, 2, 3. 

In 217 on theme 1, a novel idea had little effect, 
because of apparent weaknesses such as poor or- 
ganization, scattered elements, and lack of em- 
phasis. In 439 one defect of the control group 
may be illustrated where space is filled with 
broad lines that add little to the interest, and in 
the ‘almost human’ face which may have been be- 
cause certain information was lacking. In 726a 
serious defect of the Z group appears to be the 
unthinking attempt to render sensory information 
with no attempt to organize or unify the elements 
into good composition. The poor showing made 


by two drawings on the second theme, numbers 
738 and 783 shown later, indicate that perhaps 
some allowance should be made in setting up the 
framework for evaluation so that a ‘too obvious’ 
sense of humor would not be penalized when con- 
sidered in with 59 other drawings. 

Some advantages and disadvantages of the X, 


Y, and Z groups have been indicated as possibil- 
ities. It was thought desirable to include a sec- 
tion where the most obvious advantage and dis~- 
advantage of each group could be most clearly 
illustrated. 

The advantages of originality, freedom of ex- 
pression, unique imaginative quality, and crea- 
tivity are claimed for the unhampered art exper- 
ience. It may be, as in 485 on theme 3, that 
when a person who has ease and facility of ex- 
pression, along with a large stock of memory 
images, is allowed to concentrate on the drawing 
in a situation where no great amount of sensory 
data is present, a well organized drawing is more 
likely to be forthcoming. On the other hand, lack 
of needed information can often prevent the ele- 
ments of a drawing from fulfilling their function, 
as in 875 on theme 3. Poor use of space is evi-~- 
dent in 875, possibly because the needed infor- 
mation was not at hand. In 695 on theme 2, ideas 
which apparently had their origin in the movie 
which was seen just before the drawing was made, 
are worked into the drawing in such a way thatit 
becomes a unified whole. In 624 on theme 2, ma- 
terial which also seemed to come from the movie 
still appears to be extraneous, and the design 
disorganized. Much research needs to be done 
to demonstrate the impact of moving pictures on 
our experience, and just how permanent this im- 
pact is, in the way we assimilate the information. 
In 459 on theme 3, there are many elements in 
the drawing which appear to be well drawn and 
generally correct. The clock looks likeaclock, 
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the globe like a globe, etc. Even though there 
are such defects as perspective, and proportion 
difficulties, the elements are well placed and ap- 
pear to function. In 745 on theme 3, an apparent 
defect is excessive concern with putting things 
down just as they are, with little thought going 
into the process of making an interesting draw~- 
ing. Stiff, formal drawings often result from 
just putting down items at random in a drawing. 
There are many qualities of drawings that in- 
fluence any attempt to evaluate drawings. Some 
qualities are more or less characteristic of the 
stage of development at which these students are 
now. Drawings 126 and 413 were selected as il- 
lustrative of the naive, frank, primitive concept 
of subject matter. Much of the value of this qual- 
ity comes because the drawing has unaffected and 
childlike treatment of the subject matter in a way 
that ignores rules and principles of drawing, and 
includes only that essential to the composition. 
These two drawings were selected from the three 
sets of 60 drawings on the different themes, and 
they both happen to have been made by X group; 
however, qualities such as these mentioned above 
are often claimed for the art experience which 
has unhampered expression. Number 413 has in- 
teresting placement of objects, and space arrange- 
ment, however, the thing of special interest here 
is the drawing of various parts of the picture as 


though each were a unique, separate picture, 


viewed from a different angle. Intensity of ex- 
pression sometimes results in crude work, al- 
though the process of weeding out the irrelevant 
results in a simplicity that is an asset to the 
drawing, and not a detriment. 

Althcugh drawings with perspective problems 
would be many ina group of students in a basic 
drawing’ course, drawing number 138 on the first 
theme is an example of perspective difficulties 
that complicate drawing at this stage. Any per- 
son who has tried to draw several buildings at 
different levels in one drawing, as in 138, can 
appreciate the complexity of the problem. The 
picture plane or ground plane of an object has to 
be visualized in order to make a convincing draw- 
ing. Since drawings such as these are made on 
flat surfaces, there are only two dimensions, and 
yet objects which the observer knows to be solid 
must be made to look solid. 

As has been suggested, several drawings in- 
cluded a cartoon quality, which had varying de- 
grees of success. Where humor is employed, a 
person has to handle it with care, or the attempt 
may be too obvious. In the cartoon the subject 
is often dealt with by caricature or by allegorical 
symbols. The difficulty a person often runs into, 
in using cartoon technique, as in drawings 738 
and 783 on theme two, is that a person often ac- 
cepts hackneyed or stereotyped devices worked 
out by others, and reaches a ‘plane’ of develop- 
ment at which he is arrested. In the use of sym- 
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bols or cliches there is too great an emphasis up- 
on standard forms. 

The story telling quality is present to some 
extent in every drawing. However, group exper- 
ience similar to that undergone by group X inthis 
investigation seems to provoke more than other 
types of experience where there is a greater 
amount of sensory material in the immediate en- 
vironment at the time of the creation of the draw- 
ing. In 204 the title was thought to be necessary, 
and perhaps it is needed. . However, the inexper- 
ienced artist is often tempted to put labels on his 
drawings, to express more completely what he 
feels incapable of saying through the medium of 
drawing. ‘Activity’ is certainly the keynote of 
the drawing 217, theme 2. This drawing was one 
where judges tended to differ widely, while others 
of the more representational character were more 
stable. 

The realistic, or illustrational quality, in 
which the observer feels the actuality of the sit- 
uation pictured in the drawing was used in many 
drawings. Numbers 756 and 615 both seem to 
achieve a truthful presentation, yet while the 
drawing is very fine in 615, the total organiza- 
tion is ignored, while in 756, that is considered. 
Details are made plain in both of these drawings 
in a practical way by emphasis and subordination 
at appropriate places. This representational qual- 
ity is more than mere photographic likeness; a 
camera is too literal; here there must be a pro- 
cess of assimilation of detail, reorganization and 
interpretation, and presentation of new and more 
vivid relationships. 

In summary, because the symbols of expres- 
sion used in graphic illustration are quite differ- 
ent than those commonly used in verbal expres- 
sion the inclusion of drawings and the written an- 
alysis is felt to be essential in order that the read- 
er may get a well rounded view of important qual- 
ities evident only when the drawings themselves 
may be seen. While we may get agreement on 
some things thought to be essential to a good 
drawing, terms may often be misleading, or have 
different meanings to different people. Where 
verbal descriptions are used, descriptions must 
be tightly drawn to reduce the danger of double 
meaning or ambiguity. 

Since this investigation does identify a ‘best’ 
group of drawings, anda ‘poorest’ group, it 
would be an interesting extension of this study to 
submit all the drawings in these two groups to 
various art juries, as well as to lay juries for 
evaluation and classification into the two groups. 
High ranking drawings do not possess qualities 
thought to be necessary for a ‘good’ drawing, in 
equal amount. Apparently, special strength in 
a certain positive quality compensates to some 
extent, for lack of strength in another positive 
quality. 

Often an artist will describe his style of draw- 
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ing as having a cartoon quality, or an illustration- 
al quality, or some other descriptive term that, 
to him, sums up the impression he believes is 
created by his drawing. Sometimes the artist is 
strongly aware of his particular style of drawing, 
but sometimes he is not, or perhaps finds it dif- 
ficult to describe verbally what he can express 





graphically. 

People differ in the extent to which they make 
use of sensory data, are able to assimilate it, 
and are able to select and use it wisely in a draw- 
ing. Because experience is such a unique and 
individual thing people must be allowed to create 
in the way that is best for them. 


B. Catalog of Selected Drawings 





(See following pages. ) 
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SECTION V 
SUMMARY OF THE INVESTIGATION 


A. Summary and Conclusions 





THE EXPERIMENTAL data growing out 
of this investigation, and the conclusions result- 
ing therefrom, will be summarized in four gen- 
eral areas as follows: 


1. Group performance for the three different 
art experiences 

2. The reliability of individual performance 
in various groups 

3. The evaluation of drawings 

4. The contribution of student opinion 


1. Group Performance for the Three Groups. 
— The study of the relative effects of the three 
different art experiences, as reflected in the 
drawings by participants, has revealed thatsome 
art experiences are more valuable than others for 
the production of drawings with merit. In one of 
the three comparisons made between groups with 
the analysis of variance technique the difference 
was large enough to be statistically significant 
at the .05 level of probability. The extent and 
direction of this difference was discovered by 
working out the critical ratios between the three 
groups. In one instance the Z group had an ad- 
vantage over the Y group with a critical ratiosig- 
nificant at the .01 level. In another instance the 
X group had an advantage over the Y group with 
a critical ratio significant at the .05 level. The 
advantage that Z group had over the X group was 
not large enough to be statistically significant at 
either the .05 or the .01 level. These findings 
were amplified when 12 ‘‘Students T’’ scores 
comparing group performance on various action 
themes gave an advantage to Z group in every in- 
stance where it was compared to X group, and Y 
group; gave an advantage to X group wherever it 
was compared to Y group; and in some of these 
instances by an amount large enough to be statis- 
tically significant. 

Thus, the statistical findings favor the Z group 
in every instance where it is compared with the 
other two. In every instance where X and Y are 
compared, the X group is superior. 

2. The Reliability of Individual Performance 
in Various Groups. —An idea of the reliability 
of the performance by an individual of one group 
as compared with that of an individual of another 


may be had by an examination of individualscores. 


A few individuals whose drawings fluctuate the 
most in the ratings given by the five judges were 
chosen for study. Without special attention to 
the level of the ratings, if the amount is totaled 
that the individual varies from the mean of his 
five ratings, a general idea may be had of where 
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the greatest variation exists. Following this 
plan, an examination will reveal individuals in 
the Z group as the most stable, those in the Y 
group the next most stable, and those in the X 
group the least stable. 

Where coefficients of correlation were com- 
puted on two evaluations of a single action theme 
of 60 drawings, the Z group had the highest with 
.91, the Y group next with . 90 and the X group 
somewhat lower with .76. The X group thus ap- 
pears to be much less stable than groups Y and 
Zz. 

3. The Evaluation of Drawings. —Strict con- 
formity of agreement is neither necessary nor 
desirable in the evaluation of drawings, espec- 
ially since each judge relied upon his own per- 
sonal criteria for the evaluation. In instances 
where judges agree to a large extent on the draw- 
ings of a particular action theme, there is no 
reason to believe that the same judges will agree 
to the same extent upon the drawings of a differ- 
ent action theme. Judges agree more with them- 
selves than with each other, as might be expected. 
Judges have the least agreement on the subject 
matter of the ‘animal’ theme, to a greater extent 
on the ‘machine’ theme, and agree to the greatest 
extent on the ‘people’ theme. 

A method of increasing the reliability of eval- 
uation is possible where the judges are asked to 
make two evaluations of the same material, with 
allowance of a time lapse between evaluations. 
Correlations between two such evaluations of one 
judge will reveal which judges are the most reli- 
able. Judges can then be divided into two groups: 
the ‘most’ reliable, and the ‘least’ reliable. The 
coefficient of correlation calculated between the 
two groups will reveal the extent of agreement, 
and where the correlation is too low, it may be 
desirable to use only evaluations of the ‘most’ 
reliable group. 

4. The Contribution of Student Opinion. —A 
summary of student opinion acquired in connec~ 
tion with an investigation can be valuable in sup- 
plying information to supplement findings of a 
statistical nature, and can help to give anall 
round description of what the students are think- 
ing, their interests, problem areas, and other 
things that aid in development of art experiences 
that are vital and interesting. Student opinion 
was sought concerning their own drawing in these 
areas: On which action theme do you think you 
made the best drawing? Is 45 minutes adequate 
time in which to make a satisfactory drawing? 
How would you describe your own particular ‘style’ 
or manner of drawing? 

Most people thought that they made their best 
drawing on theme 3, the ‘people’ theme. The 45 
minutes was considered by most people to be ad- 
equate. Some found it difficult to describe their 
own style, but the remarks in response indicated 
that most people were aware of their style being 
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in a ‘stage’ of developing. 


B. Problems Suggested by This Investigation 





Since the symbols of expression used inart 
are often very different than those used in speech, 
writing, and the use of numbers, the researchin 
Art Education must surmount the fact that the 
non-verbal nature of expression increases the 
difficulties encountered in description and meas- 
urement. Traditional practices in art are inpart 
responsible for some of the general problems 
faced by the investigator; examples of these are 
the tendency to set up a dichotomy of those who 
are ‘good’ in art and those who are not, the ten- 
dency to judge art from an adult standard, too 
much selection of students in the past, without 
adequate provision for the needs of all the stud- 
ents, and many others. Since the problems ap- 
pear most naturally in question form, they are 
stated here in that form: 


1. How can we relate art experiences more di- 
rectly to the needs of everyday life? 

2. Following the identification of needs of the 
students, how can we be sure that these are 
‘felt needs’? 

. How can we develop in the student capacity and 
desire for more continuous self-education to 
the end that each experience is meaningfuland 
worthwhile ? 

. To what extent can we plan art experiences 
around the current interests of the students? 

. Ina situation where art experiences may be 
compared, what art experiences are of the 
most value for specific groups and for the in- 
dividuals that make up these groups? 


. Implications of This Investigation for Educa- 
tion 





To achieve the full potential of which we, as 
human beings are capable, and to fulfill our duty 
and obligation as citizens and leaders in a demo- 
cratic society, we must know more about the re- 
lation of Art to human behavior in actual learn- 
ing situations. The following appear to be im- 
portant implications and ways of application of 
these findings, whether for the construction of a 
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general art course, or for education in general: 


1. Exposure to a variety of problem situations 
involving many and varied materials and methods 
of expression in the field of Art, allows the stud- 
ent to become acquainted with basic facts and 
principles important in the creative process. 
Through these problem situations the student is 
led to develop a personal system of values that 
constitute his personal art judgment, and help 
him to become an intelligent consumer, critic and 
creator of art products. 


2. Art may be fostered under any number of 
stimulating conditions, and it is impossible to 
say that procedure A is better than procedure B 
for all situations, or for all people. However, 
in any situation, the teacher should be free to 
diseuss issues with the students, make sugges-~ 
tions, point out alternate courses of action, guide 
and help each individual student in every way pos- 
sible. 

3. Because of the diversity and individuality 
of experience, there is no one appealing type of 
subject matter. Interests are as varied and nu- 
merous as the number of students in the class, 
so that offerings must be individualized to give 
purpose, stimulate effort, and give meaning to 
the content. 

4. Various attempts must be made to adjust 
the learning experience to the way individual 
students learn. For example, some learn best 
through lecture and demonstration methods where 
the emphasis is on verbal learning; others, hand- 
icapped there, learn best in a laboratory situa- 
tion where the actual manipulation allows more 
motor coordination in the learning process; while 
others may have to depend more upon a spacial 
expression in three dimensional media. 


5. Development must be expected and encour- 
aged on all levels, since experience is a contin- 
uous, cumulative thing. If we recognize this 
fact, at no point in the development process will 
the child be judged by adult standards. 

6. If we tie our art experiences, as we must, 
to contemporary life, it is necessary that we go 
beyond the narrow limits of the classroom, to 
make eurricular and co-curricular experience 
more meaningful and more functional for all. 





A STUDY OF FOURTH GRADE CHILDREN’S 
COMPREHENSION OF CERTAIN VERBAL 
ABSTRACTIONS 


MARY C. SERRA* 
Temple University 
Philadelphia, Pennsylvania 


THE PROBLEM 


Statement of the Problem 





THE CHIEF purpose of this study was to 
investigate the ability of fourth-grade pupils to 
comprehend different verbal abstractions as 
identified in vocabulary common to primary 
grades. Specific data were obtained on the fol- 
lowing questions: 


1. What relationship exists between comprehen- 
sion of verbal abstractions and background 
of information? 


a. between ability to classify ideas and back- 
ground of information? 

b. between ability to index ideas and back- 
ground of information? 


. What relationship exists between comprehen- 
sion of verbal abstractions and intelligence ? 


a. between classifying ability and intelligence? 
b. between indexing ability and intelligence? 


. What relationship exists between classifying 
and indexing ability? 


Justification of the Study 





The justification for this study may be estab- 
lished as follows: 


1. To investigate the comprehension of cer- 
tain verbal abstractions by employing them in 
tools designed to measure ability to classify and 
index ideas. 


2. To determine to what extent the ability to 
classify and index ideas varies with intelligence. 








Limitations of this Study 





This study is concerned with the ability of a 
group of fourth-grade subjects to classify and in- 
dex. To determine the extent to which subjects 
of this age group possess this ability, an Inven- 
tory on Background of Information, a test onClass- 
ifying Ideas, and a test on Indexing Ideas were ad- 
ministered. The verbal intelligence of the popu- 
lation of this study was determined by means of 
the Stanford-Binet Test of Intelligence, Form L, 
1937 Revision. 1 

The Population. — Three populations were used 
in this study: 





1. Population used for the experimental inventory 
on background of information. One hundred 
subjects were used; twenty-five cases in each 
of four grade levels. 


a. Sex. Both sexes were used in this study. 

b. Age. The chronological age range was 
from 6 to 10 years, inclusive. 

c. School Experiences. The cases selected 
for the study were obtained from grades one 
to four, inclusive. 

. Geographical Area. The subjects were se~- 
lected from Garrettford School in Drexel 
Hill, Pennsylvania. 


. Population used for the experimental tests on 
classifying and indexing ideas. Three hundred 
subjects were used; one hundred cases in each 
of three grade levels. 


a. Sex. Both sexes were used. 

b. Age. The chronological age range was from 
8 to 11 years, inclusive. 

c. School Experiences. The subjects selected 
for the study were obtained from grades 
three to four, inclusive. 


Present address: Illinois State Normal University, Normal, Illinois. 


1. Published by Houghton Mifflin Co., Boston, Massachusetts. 
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d. Geographical Area. The subjects were 
selected from Garrettford School in Drex- 
el Hill, Pennsylvania. 


lationship existing among various abilities. 
Terminology 


3. Population used for the final survey. One 1. ‘‘Verbal Abstraction’’ is used synonymously 


hundred fourth grade subjects were used. 


a. Sex. Both sexes were used. 

b. Age. The chronological age range was 
from 9 to 10 years, inclusive. 

c. Intelligence. The intelligence quotient 
range was from 72 to 151. 

d. Geographical Area. The subjects for the 
final survey were from nine fourth grades 
in Ridley Township School District, Penn- 
sylvania. 


Abstractions Used in this Study. —Three sets 
of primary basic readers and a set of science 





books were analyzed for 246 verbal abstractions: 


(1) Easy Growth in Reading Series, 2 (2) Curric- 
ulum Foundation Series, (3) Betts Basic Read- 
ers, 4 and (4) The Wonderworld of Science. 5 
Tests Used in this Study. —One standardized 
test and three instruments that were construct- 
ed for this study were used. The Stanford-Binet 
Test of Intelligence, Form L, 1937 Revision, 
was the standardized test used to determine the 
verbal intelligence of the population. The other 
three instruments were: (1) an inventory on 
background of information, (2) a test on class- 
ifying ideas, and (3) a test on indexing ideas. 
Statistical Procedures. —The subjects were 
given a series of tests to measure various abil- 
ities. To determine whether the instruments 
used to measure certain abilities were signifi- 
cant, two statistical techniques were employed: 




















1. The standard error of the difference be- 
tween proportions was used to determine 
significance of items. 

. The reliability of the tests was establish- 
ed by using the split-half method and the 
Spearman~Brown ‘‘Prophecy-Formula. ’’ 


The results obtained from the tests were 
compared by employing the Pearson Product 
Moment Formula. This technique was used be- 
cause it provided a way of determining the re- 





with verbal concept. For example, the writ- 
ten symbol dog, representing a special animal, 
is a verbal abstraction or concept. Verbal 
concepts go up and down the ladder of abstrac- 
tion. In order of increasing abstraction, more 
characteristics are omitted: 


a. The descriptive or naming level is the low- 
est verbal level of abstraction. For example, 
Skippy, the name of a dog, is an abstrac- 
tion at the lowest verbal level; it is still an 
abstraction since some characteristics of 
the real Skippy have been omitted. 

. The abstraction dog is at a higher level than 
Skippy since more characteristics have been 
omitted. Dog may not mean a special dog, 
but any dog at all. 

. The verbal abstraction animal is at a higher 
level than Skippy or dog. Still more char- 
acteristics have been omitted in the abstrac- 
tion animal than in dog. Animal is a more 
general term than dog or Skippy. 


. **Category’’ is the term used to indicate a broad 


division or group in which persons, places, ob- 
jects, or events having common characteristics 
can be placed. For example, animal is the 
group name or broad division to which dogs, 
cats, horses, etc., belong. 


. ‘*Classifying’’ is the ability to put persons, 


places, objects, or events with similar char- 
acteristics or logical relationships in commonly 
accepted groups or categories. For example, 
man, dog, and horse have similar characteris- 
tics and can be placed in the animal category. 


. ‘Concept’’ is defined as a ‘‘meaning suffic- 


iently individualized to be directly grasped and 
readily used, and thus fixed by a word. ’’6 


. ‘Indexing’’ is the ability to name specific per- 


sons, places, objects, or events that have been 
placed in a special category by society. In the 
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animal category, the naming of a special type 
of animal, such as rat, would be indexing. 


A REVIEW OF KINDRED LITERATURE 


There are a large number of studies reported 
in the literature which bear upon different aspects 
of the broad problem of verbal abstractions or 
concepts as they are represented by words. Al- 
though no research was found dealing directly 
with classifying and indexing as defined in this 
study, the kindred literature reported in this 
section will provide a background for an under- 
standing of the problem. The studies reviewed 
are referred to under the following three aspects 
of the problem: (1) how to develop concepts and 
their verbal representations, (2) measurement 
of concepts, and (3) concept burden of instruc- 
tional materials. 


How to Develop Concepts and Their Verbal 
Representations 








Numerous experimenters investigating the 
area of concepts were interested in determining 
best teaching procedures rather than establish- 
ing principles of how to develop concepts. Infer- 
ences drawn from research into the way concepts 
develop and from the factors that influence their 
development provide the needed principles. 

Direct Experience. —Findings from researc i: 
reviewed on factors influencing concept develop- 
ment indicate that the more direct the experience 
on which the concept is built, the greater will be 
the individual’s knowledge and understanding of 
that concept. 

Direct experience is necessary in order to 
build concepts. It is impossible, however, for 
any one to develop all the concepts needed in 
modern life on the basis of direct experience 
alone. Vicarious experience must be utilized 
and much of it will be received through the med- 
ium of language. When verbal symbols are ad- 
ded to the old stock of established ones, it is 
essential that these initial concepts be formed 
on the basis of direct experience. In order to 
build concepts, then, it is necessary to provide 
experience in order to establish the simple con- 
cepts that will be combined and manipulated sub- 
sequently to form the more complex concepts. 
Concepts that can be traced back only to verbal 
language or symbols acquired through language 
result in mere verbalism. 

Margaret Bedwell’s (1) investigation estab- 
lished the fact that it is possible to have verbal 
or factual knowledge without having a functional 
concept. Practical experience, as she points 
out, is the most important factor in concept de- 
velopment. Sister M. B. Herbers (15) inves- 
tigated the comprehension difficulties of 30 
third-grade pupils. This study indicated that 
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concrete materials and personal experiences are 
necessary to overcome verbalism. Osburn, Hunt- 
ington, and Weeks (27) experimented with vicar- 
ious experience between the levels of direct ex- 
perience and of verbalism. Their findings were 
that experiences with pictures, illustrations, mod- 
els, and the like should be used to make concrete 
the relationships implied in language. 

H. J. Sachs (30) makes the point that children 
do not acquire concepts by merely meeting words 
in context. He worked with 416 freshmen to de- 
termine the extent of their meaning vocabulary. 
His study shows the limitations of the reading 
method of improving vocabulary. The work of 
Ruth L. Sims (34) emphasizes that the role of ex- 
perience is of utmost importance in the develop- 
ment of concepts. Helen B. Stolte (38), working 
with geographical concepts, draws the same con- 
clusions. M. Theriesa Wiederfeld (43) in the field 
of history, concludes that building concepts neces~ 
sitates providing experiences. 

Vocabulary Development. —Much research de- 
voted to determining the most effective means of 
increasing vocabulary assumes that enlargement 
of vocabulary is a virtue in itself without question- 
ing the dimensions of the concepts with which 
words are associated. In that direction lies verb- 
alism. In the mass, however, this researchdem-~- 
onstrates that vocabulary is increased by exper- 
iences of two kinds: 





1. Experience with the raw materials of the 
concepts for which given words are sym- 
bols; that is, experiences with objects and 
processes and with lower level concepts on 
which the required concepts are built. 


. Experience with the given word itself; tliat 
is, hearing the word, speaking the word; 
and reading and writing it. 


Experience with the raw materials of concepts 
develops the concept; experience with the word 
associates word and concept. 

Dunkel’s (9) conclusion that the ability to deter- 
mine the precise meaning of a word is related to 
the ability to read with comprehension gives the 
clue to the reason for the great quantity of inves- 
tigations of word meaning and vocabulary develop- 
ment. He constructed a new type of vocabulary 
test. He was dissatisfied with the conventional 
type of test which assumes a ‘‘core-meaning’”’ 
or ‘‘sphere of meaning’’ for each word. These 
tests, he felt, did nothing to test the student’s in- 
terpretation of the precise meaning taken on by a 
word used in a particular situation. In Dunkel’s 
test, words were used in a paragraph and then in 
five sentences. Subjects were to mark the item 
which had the same meaning as in the paragraph. 
This test was administered to subjects in the 
tenth, thirteenth, and fourteenth grades. He con- 
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cluded that: 


1, The ability to determine the precise mean- 
ing of a word is related to the ability to 
read with comprehension. 


. Education and maturity lead to develop- 
ment of the ability to determine the pre- 
cise meaning of a word. 


Ralph Haefner (13), Harry K. Newburn (25), 
Glenda Liddell (18), H. J. Sachs (30), William 
8S. Gray and Eleanor Holmes (11) are a few of 
the investigators concluding that it seemed pos- 
sible to improve the vocabulary of a group of 
children and adults by merely exposing them for 
a few minutes each day to a new word. Vocabu- 
lary is acquired by casual learning and by form- 
al drill, 

Multiple-Meaning of Words. —Related, but 
somewhat opposed to the research in vocabulary 
building is the research in semantics. The in- 
vestigator in vocabulary meaning assumes that 
the more words a child knows the more readily 
will his concepts be formed, The semanticist 
says, ‘‘Words do not mean what they say.’’ But 
through semantics, another factor influencing 
concept development is recognized, i.e., the 
multiple-meaning of words. 

The real significance of multiple-meaning 
arises from the fact that we receive so many of 
our concepts through stimuli in the form of words, 
spoken or written. No one can have all the ex- 
periences directly that are basic to understand- 
ing modern life. Vicarious experiences must be 
resorted to, and in practice much of it turns out 
to be in the form of spoken or written language. 
For the reception of language, there must be 
agreement upon the meanings of words. When 
words may have from one to a score of accepted 
meaning, the recipient is faced with a large sort- 
ing task with each sentence he receives. Let him 
fail to sort out the intended meaning of any one 
word and the concept he forms may be totally at 
fault. 

One means of developing concepts is through 
extending vocabularies. The investigations of 
Blair (2), Curoe (7,8), Gray and Holmes (11), 
Haefner (13), Liddell (18), Newburn (25), Sachs 
(30), Sanderson (31), Shannon and Kittle (33), 
Tate (39), Traxler (40), Waring (41), andWaters 
(42), all point out that direct study of words and 
their meanings is productive in extending vocab- 
ulary. 





The Measurement of Concepts 





In nearly all research in the field of concepts, 
investigators have experienced difficulty in their 
efforts to measure concepts. In practically all 
the studies in this area, measurement of some 





type was required. Attempts have been made to 
evaluate concepts by a number of devices. 

Several types of testing can be adopted to meas- 
ure the existence of a given concept. L. J. Cron- 
bach (6), Ruth Looby (20), Hyman Meltzer (22), 
and Helen Stolte (38) found that the oral interview 
technique was a superior technique in measuring 
concept development. 

Attempts have been made to measure concepts 
by causing the subjects to perform appropriate 
acts as an index of their presence. Margaret 
Bedwell (1), Cofer and Smith (5), Hazlitt (14), 
Long and Welch (19), Mott (23), Sims (35), Rash- 
kis, Cushman, and Landis (28), and Chard and 
Swartz (4) employed various performance tech- 
niques to measure concepts in their research. Ap- 
propriate acts to demonstrate the concept of an ob- 
ject, relationship, or a principle is one type of 
performance test. Sorting stimuli, words, phrases, 
or objects to demonstrate the understanding of 
certain objects is a second kind of performance 
test. Neither type appeared to measure accurately 
the acquisition of concepts. 

Many experimenters have used multiple-choice 
tests to measure knowledge of word meaning. V. H. 
Kelley (17) concluded that the five types of objec- 
tive word meaning tests he used in his investigation 
did not possess sufficient validity to make it valu- 
able as an instrument for measuring the total word 
meaning knowledge of children. Cronbach (6), Dun- 
kel (9), Eskridge (10), Serenius (32), andStalnaker 
(37) concluded that selected distractors should be 
used in multiple choice tests. 

Murphy (24) added free association tests to his 
investigation. He worked with college freshmen. 
He found association tests to be a device useful 
in supplying an index to concepts. Buswelland 
John (3) investigated the vocabulary of arithmetic. 
They found that the ability to make an association 
of an appropriate word with a concept cannot be 
taken as evidence of the extent of a concept. 

There is agreement among experimenters that 
regardless of the technique used in measuring the 
development of a given concept, the ability to util- 
ize a concept in one situation is not an index that 
it can be utilized in other situations. 


Concept Burden of Instructional Material 





Pertinent research establishes the fact that the 
concept burden of instructional materials is too 
heavy. It points to growing tendency to lighten the 
load in content-subject textbooks and more partic- 
ularly in the series of books designed for basal 
reading instruction. It emphasizes the need to 
consider the concept burden as well as the vocab- 
ulary burden of instructional materials and sug- 
gests a growing concern with the distinction be- 
tween well established concepts based on exper- 
iences and mere verbalism. 

Some of the studies in this area have little or 
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no individual statistical significance and their 
specific findings are open to question. The agree- 
ment among them, however, cannot be ignored. 


Social Studies 


Bedwell (1) studied children’s comprehension 
of concepts of quantity in third grade social stud- 
ies reading materials. Both definite and indef- 
inite terms were found to be of differing degrees 
of difficulty. Children demonstrated that it was 
possible to have a factual knowledge of a term 
without having a functional concept of the same 
term. Even in the restricted field of concepts 
of quantity at the third reader level, the load 
was too heavy for the children and verbalism re- 
sulted. Definite and indefinite terms for quant- 
ity were misinterpreted because children lacked 
concepts based on experience. This makes it 
clear that concept burden is relative, to be eval- 
uated only in terms of the established concepts 
of intended readers. 

Ritter (29) very carefully studied the words 
and meanings (and by inference, the concepts) 
used in two popular fourth grade geography text- 
books. Her findings are glaring when contrast- 
ed to the usual vocabulary burden of basal read- 
ing series. In the more recent basal reading 
books for grade four, the authors, who can be 
presumed to have given careful consideration to 
children’s capacity to acquire new vocabulary 
effectively, introduced roughly 1000 new words. 
Ritter found that 2195 technical, difficult, or un- 
usual terms are introduced in one fourth grade 
geography. In the basal reading instruction 
nothing is more important than the building of 
reading vocabulary on the basis of well-estab- 
lished concepts. In geography texts, vocabulary 
is relatively incidental. One author of a geog- 
raphy text doubles the burden the authors of 
readers feel children can carry. 

Springman (36) in a study of sixth grade pup- 
ils’ understanding of statements in social stud- 
ies textbooks found that only about half of the 
children fully comprehended the statements. He 
concluded that the concepts were muchtoo heavy 
a load for the children he tested and it can be 
implied that it would constitute excessive burden 
for many children. 


Basal Reading Materials 





Marcum (21) made a direct attack upon the 
concept burden of primary basal reading mater- 
ials. She analyzed the concept burden of prim- 
ary basal reading material. She analyzed the 
concepts expressed in fifteen series of pre- 
primers, primers, first, and second grade 
readers, and found the following total number 
of concepts at the indicated levels: 
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. 110 different concepts in 15 preprimers 

. 406 different concepts in 15 primers 

. 719 different concepts in 15 first readers 

. 1487 different concepts in 15 second readers 


At any one level, not more than 17 concepts were 
common to all series, only one concept was com- 
mon to all preprimers. 

Sims (34) concluded that the concepts which a 
child will need for handling materials adequately 
through reading can be determined by analysis. 
She recommended the compilation and use of ‘‘con- 
cept vocabularies’’ or ‘‘concept lists. ’’ 

Ogle (26) found that the concept burden varied 
from one series of basal readers to another at the 
primary level. He classified the concepts and 
found twice as many relating to house and homeas 
in any other classification, with concepts of met- 
als occurring least often. 

As of 1938, Hockett (16) reported that the basic 
vocabulary of ‘‘recent’* primers and first readers 
was not as extensive as in older books. There was 
more repetition of words in ‘‘recent’’ readers than 
in earlier editions. There is no evidence that this 
trend has been reversed. Fewer words and more 
experience with them is the major promise of the 
authors of basal readers. The same approach 
could well be assigned to the treatment of concepts. 

Gunderson (12) found some hopeful signs in 19- 
42. She concluded that: 


1. Basal readers for the first three grades 
make provision for the development of mean- 
ing vocabularies in verbs. 

. The large number of synonyms introduced at 
progressive levels enabled children to be- 
come aware of the common as well as the 
more specific meanings of words. 

. The vocabulary load increases from the pre- 
primer to the third reader for growth in ac- 
curacy of comprehension and depth of inter- 
pretation. 

. More colorful and precise words are intro- 
duced in the second and third readers for 
finer interpretation, developing shades of 
feeling, and a sensitivity for meaning. 


Gunderson’s study dealt with words and their 
meanings rather than with concepts. She analyzed 
ten sets of readers. Her study shows the serious 
attention given by authors of basal readers to the 
nature of learning in children. 

The real harm in overloading instructional ma- 
terials with concepts is that overloading produces 
verbalism (or no learning at all). Looby (20) found 
in investigating the understandings children in the 
sixth grade derive from their reading of literature 
that verbalism is rampant. Children’s understand- 
ing of ‘‘the stern of the ship”’ placed the stern 
from one end of the boat to the other. ‘‘Breathing 
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ing space’’ meant a space in the mouth. A man 
who was ‘‘slain’’ meant that he had servants. 
Yet children read and used these words. 

In books overloaded with difficult terms, a 
large portion of these terms are not associated 
in any usable manner with established concepts. 
In some cases, children can ascribe no meaning 
to the terms; in other cases they ascribe wrong 
meanings, vague meanings, or partially correct 
meanings. In any case, where correct meaning 
is not ascribed, the best that can result from 
reading the term is verbalism. 


PROCEDURES 


This study was chiefly concerned with evalu- 
ating certain abilities involved in comprehension 
of concepts at different levels of complexity. To 
measure relationships existing among these abil- 
ities, two main procedures were followed: con- 
struction of instruments, and a survey employ- 
ing them. 

Before it was possible to conduct the survey, 
three tests needed to be constructed: (1) Back- 
ground of information inventory, (2) tests on 
classifying ideas, and (3) tests on indexing ideas. 
For the background of. information inventory, 
primary reading materials, currently used, 
were analyzed for 246 general and science con- 
cepts. These concepts were readily classified 
at different levels of abstraction. Background 
of information for these concepts was determined 
by constructing and standardizing an inventory 
covering the 246 concepts. The initial inventory 
of 246 items was revised on the advice of ‘‘ex- 
pert’’ judgment. It was then administered indi- 
vidually to a population at four different grade 
levels: 25 subjects in each of grades one, two, 
three and four. The level of difficulty of items 
was established by two criteria: (1) each item 
was answered correctly by at least 88 percent 
of the subjects in the fourth grade; and (2) each 
item was answered correctly by an average of 
76 percent or less by the subjects in all four 
grades. 

A final inventory of 100 items was construct- 
ed based on the results of the experimental in- 
ventory. Reliability was obtained on the hun- 
dred items that met the criteria established for 
level of difficulty of items. The techniques em- 
ployed to estimate reliability were the (1) Split- 
Half Method, and (2) the Spearman-Brown 
‘‘Prophecy~Formula. ’’ The reliability coeffic- 
ient was estimated to be . 98, corrected. 99. 

Preliminary and final tests on classifying of 
ideas were constructed. Concepts common to 
the final inventory were included in these tests. 
An analogy technique was employed throughout 
the test. The following criteria were followed 
in building the analogies: 
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. Two abstractions were used in the first 
part of the analogy. The first abstraction 
was a lower level abstraction than the sec- 
ond one; e.g., Sally is togirl. Sally isa 
lower level verbal abstraction than is girl. 





. One abstraction was used in the second part 
of the analogy. It was coordinate with the 
first abstraction used in the analogy; e. g., 
as Bob is to. Bob is at the same level of 
abstraction as Sally. Bob and Sally are co- 
ordinate levels of verbal abstractions. 


. Three choices were given in each analogy. 
The choices were at three different levels 
of abstractions; e.g., brother, Billy, boy. 
1) Brother is a higher level verbal abstrac- 
tion than is Billy but lower than boy. 

2) Boy is a higher level verbal abstraction 
than brother or Billy. 

3) Billy is the abstraction at the lowest 
‘level, ’’ 


. The choice representing the best answer 
was coordinate with the second abstraction 
in the first part of the analogy. Boy is co- 
ordinate with girl, the second verbal ab- 
straction in the first part of the analogy. 


. The abstraction representing the best ans- 
wer was alternated; it was not in the same 
position for more than two consecutive an- 
alogies. 


The experimental classifying test of 56 anal- 
ogies was administered to a population at three 
grade levels: one hundred subjects in each of 
grades three, four, and five. The Z-score of 
each item in the tests taken by third and fourth 
grade subjects was determined by the standard 
error of the difference between proportions. The 
Split-Half Method and Spearman-Brown ‘‘Prophecy- 
Formula’’ were employed to estimate a coefficient 
of reliability of .94, corrected . 97. 

The fifty items included in the final test on 
classifying met the following criteria: 


1. Combined data of each item between grades 
three and four giving Z-Score of at least 3.13, 
significant at the one percent level. Z-Score 
was determined by Standard Error of the Dif- 
ference Between Proportions; in this case, 
top one hundred and bottom one hundred. 


. Each item on the test taken by fourth grade 
subjects having a Z-Score of at least . 40. 
Fifty items selected in order to have a mean 
Z-Score of 2.00, significant at the 5 percent 
level, Z-Score was determined by the Stand- 
ard Error of the Difference Between Propor- 
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tions; in this case, using the top fifty and 
bottom fifty. 


- Minimum increase of eighteen percent cor- 
rect responses for each item from the third 
to the fourth grade level. 


Percent of correct responses for each item 
in the fifth grade tests the same or higher 
than in the fourth grade. 


The items selected were arranged in order 
of increasing difficulty as indicated by fourth 
grade data. 

Experimental and final tests on indexing ideas 
were constructed following the same procedures 
as in the classifying tests. The following cri- 
teria were followed in making the analogies for 
the indexing test: 


a. Two abstractions were used in the first part 
of the analogy. The first abstraction was at 
a higher level abstraction than the second 
one, e.g., Birdis to robin. Bird is a higher 
level verbal abstraction than robin. 





. One abstraction was used in the second part 
of the analogy. It was coordinate with the 
first abstraction used in the analogy, e. g., 


as insect is to. Insect and bird are coordin- 
ate levels of verbal abstractions. 





. Three choices were given in each analogy. 
The choices were at different levels of ab- 
straction, e.g., grasshopper, animal and 
life. 

1) Grasshopper is a lower level abstraction 
than is animal or life. 

2) Animal is a higher level abstraction than 
grasshopper but a lower level than life. 

3) Life is a higher level abstraction than 
grasshopper or animal. 





. The choice representing the best answer was 
coordinate with the second abstraction in the 
first part of the analogy, e.g., grasshopper 
is coordinate with robin. Grasshopper is the 
best answer. 


. The abstraction representing the best answer 
was alternated; it was not in the same posi- 
tion for more than two consecutive analogies. 


The same population was used in the indexing 
test as in the classifying test. The Z-Score of 
each item in the tests taken by third and fourth 
grade subjects was determined by the standard 
error of the difference between proportions. 
The Split-Half Method and Spearman-Brown 
‘‘Prophecy~Formula”’ estimated the coefficient 
of reliability to be . 88, correct . 88. 
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The fifty items that were included in the final 
test on indexing ideas met the following criteria: 


1. Combined data of each item between grades 
three and four giving a Z~-Score of at least 3.00, 
significant at the one percent level. Z-Score 
was determined by the standard error of the 
difference between proportions; in this case, 
top one hundred and bottom one hundred. 


. Each item on the test taken by fourth grade sub- 
jects having a Z-Score of at least .40. Fifty 
items selected in order to have a mean Z-Score 
of 2.02, significant at the 5 percent level. Z- 
Score was determined by the Standard Error 
of the Difference Between Proportions; in this 
case, uSing the top and bottom fifty. 


. Minimum increase of eighteen percent of cor- 
rect responses for each item from the third to 
the fourth grade level. 

a) Fourth grade subjects. All ninety-four sub- 
jects in three fourth grade rooms were test- 
ed. Six additional fourth grade pupils were 
chosen at random from another fourth grade 
class. 

b) Fifth-grade subjects. In three fifth grade 
classes there were ninety~-seven pupils. 
Three pupils from another fifth grade class 
were added. 


After the preliminary steps of constructing and 
standardizing instruments were completed, the 
final survey was made, The three instruments 
were administered to one hundred fourth grade 
subjects. The subjects had been administered 
the Stanford-Binet Test of Intelligence, Form L, 
1937 Revision, during their first year of school. 
The purpose of the survey was to investigate re- 
lationships that exist among the comprehension 
of verbal abstractions, background of information, 
and intelligence. The Pearson Product Moment 
Coefficient of correlation was employed to deter- 
mine relationships among abilities. 


SUMMARY OF RESULTS 


The experimental Inventory on Background of 
Information was administered to subjects at four 
grade levels, to determine the discriminative 
value of its items. A summary of data is pre- 
sented in Table I. 

The combined data on the experimental Inven- 
tory on Background of Information taken by 100 
subjects in four grade levels are summarized in 
Table 0. These data are concerned with item 
difficulty for the total population. 


Experimental Test on Classifying Ideas 





The data from the experimental test on classi- 
fying ideas will be presented in two categories: 
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TABLE I 
EXPERIMENTAL DATA INVENTORY ON BACKGROUND OF INFORMA- 
TION: PERCENT OF POPULATION WITH CORRECT ITEMS 
BY GRADE LEVELS 


(25 Subjects at Each Grade Level) 





Grade I Grade I Grade III Grade IV 

No. of No. of No. of No. of 

Percent of Correct Correct Correct Correct 
Population Items Items Items Items 





— 
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— 
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of Items 
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TABLE II 


EXPERIMENTAL DATA ON INVENTORY OF BACK- 
GROUND OF INFORMATION: AVERAGE PER- 
CENT OF TOTAL POPULATION WITH 
CORRECT ITEMS 


(25 Subjects in Each of Grades I, II, II, and IV) 





Average Percent of Number of Correct 


Total Population Items 





80 - 89 8 
79 - 79 21 
60 - 69 25 
50 - 59 27 
40 - 49 36 
30 - 39 35 
20 - 29 25 
10 - 19 36 
1-9 _26 
239 

No. of Items Failed 7 


Total No. of Items 246 





TABLE III 


SUMMARY OF DATA ON EXPERIMENTAL CLASSIFYING 


TEST FOR THREE GRADE LEVELS 





Grade II Grade IV 
Scores f 


Grade V 





55 - 59 
50 - 54 
45 - 49 
40 - 44 
35 - 39 
30 - 34 
25 - 29 
20 - 24 
15 - 19 
10 - 14 


Total No. of 
Subjects 


Mean 
SD 
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TABLE IV 


SUMMARY OF DATA: ITEM ANALYSIS FOR EXPERIMENTAL TEST 
ON CLASSIFYING IDEAS 


(100 Subjects in Grades III and IV) 





Grade III Grade IV Grades III - IV 
(Combined Data) 
No. of No. of No. of 
Z-Score for Items Items Items Items 





.12 - 1. 95* 12 26 1 
1.96 - 2.57** 23 11 1 


2.58 - 6. 36*** 21 19 


Total No. of Items 56 56 





* Not significant 
** Significant at the 5 percent level 
***Significant at the 1 percent level 


TABLE V 


SUMMARY OF DATA ON EXPERIMENTAL INDEXING 
TEST FOR THREE GRADE LEVELS 





Grade III Grade IV Grade V 
Scores f 





50 - 54 
45 - 49 
40 - 44 
35 - 39 
30 - 34 
25 - 29 
20 - 24 
15 - 19 
10 - 14 


Total 
Population 


Mean 
SD 
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TABLE VI 


SUMMARY OF DATA: ITEM ANALYSIS FOR EXPERIMENTAL TEST 
ON INDEXING IDEAS 


(100 Subjects in Grades III and IV) 





Grade II Grade IV Grades III - IV 


(Combined Data) 
No. of No. of No. of 
Z-Score for Items Items Items Items 





.00 - 1. 95* 27 19 2 
1.96 - 2.57** 20 32 1 


2.58 - 6. 36*** 9 5 


Total No. of Items 56 56 





* Not significant 
** Significant at the 5 percent level 
***Significant at the 1 percent level 


TABLE VII 


TABLE VI SUMMARY OF DATA ON FINAL CLASS- 


IFYING TEST 
SUMMARY OF DATA: FINAL INVENTORY 
ON BACKGROUND OF INFORMATION 
(100 Fourth Grade Subjects) Grade IV 
Scores f 


45 - 49 12 














Grade IV 





91 - 100 63 35 - 39 24 


B1- 90 28 er 
71 - 80 9s - 30 
61- 70 a 


51 60 15 - 19 


Total Population 10 - 14 


Mean 
SD Total Population 





Mean 
SD 
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TABLE Ix 


SUMMARY OF DATA ON FINAL INDEX- 
ING TEST 





Grade IV 
Scores f 





40 - 44 8 
35 - 39 26 
30 - 34 34 
25 - 29 13 
20 ~ 24 
15 - 19 


10 - 14 


Total Population 


Mean 
SD 





TABLE X 


SUMMARY OF RELATIONSHIPS: BACKGROUND OF INFORMATION, 
CLASSIFYING, INDEXING, AND INTELLIGENCE 


(100 Fourth-Grade Subjects) 





Instruments 





Inventory on Background of Informa- 
tion with Classifying Test 

Inventory on Background of Informa- 
tion with Indexing Test 

Inventory on Background of Informa- 
tion with Binet 

Classifying Test with Binet 

Indexing Test with Binet 

Classifying Test with Indexing Test 


I+ 1+ 1+ I+ 
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(1) scores on classifying test and (2) analysis of 
items. 

Scores on Classifying Test. —The frequency 
distributions, with means and standard devia- 
tions for grades three, four, and five are pre- 
sented in Table II. 

The findings indicate that the 56 items inthe 
Classifying Test were discriminating among the 
abilities of pupils in three grades. 

Analysis of Items. —The statistical technique 
used to determine significance of items for the 
test on classifying was the standard error ofthe 
difference between proportions. 

A summary of the data on item analysis for 
the Classifying Tests for grades three and four 
is presented in Table IV. 

The findings on the significance of items at 
the 5 or 1 percent level of confidence were: (1) 
third grade subjects, 79 percent; (2) fourth grade 
subjects, 53 percent; and (3) combined data for 
third and fourth grade subjects, 98 percent. 








Experimental Test on Indexing Ideas 





The data from the experimental test on index- 
ing ideas will be presented in two categories: 

(1) scores on classifying tests, and (2) analysis 
of items. 

Scores on Indexing Test. —-The frequency 
distributions, with means and standard devia~ 
tions for grades three, four, and five are pre- 
sented in Table V. The findings indicate that 
the 56 items in the Indexing Tests were discrim- 
inating in difficulty among the three grade levels. 

Analysis of Items. —The statistical technique 
used to determine significance of items for the 
Indexing Test was the standard error of the dif- 
ference between propertions. 

A summary of the data on item analysis for 
the Indexing Test for grades three and four is 
presented in Table VI. 

The findings on the significance of items at 
the 5 or 1 percent level of confidence were: (1) 
third grade subjects, 52 percent; (2) fourthgrade 
subjects, 66 percent; and (3) combined data for 
third and fourth grade subjects, 98 percent. 








Results of Tests Employed in the Final Survey 





In the final survey, the three instruments con- 
structed for this investigation were administer- 
ed to a fourth grade population. The results of 
the Stanford-Binet Test of Intelligence, Form L, 
1937 Revision, that was administered to the 
subjects during their first year of schoolare 
reported last. Final Inventory on Background 
of Information was so constructed that fourth 
grade pupils would answer all items at 88 to 100 
percent. A summary of the data on the final 
Inventory taken by the 100 subjects participating 
in the actual survey is reported in Table VII. 
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Final Test on Classifying Ideas 








Data concerning the Classifying Test adminis- 
tered to the 100 fourth grade subjects participat- 
ing in the survey are presented in Table VIII. The 
frequency distribution of the scores obtained on 
the fifty items, with the mean and standard devi- 
ation, are reported. 


Final Test on Indexing Ideas 





Data concerning the indexing test administered 
to the 100 fourth grade subjects participating in 
the final survey are presented in Table IX. The 
frequency distribution of scores obtained on the 
fifty items, with the mean and standard deviation 
are included in Table IX. 


Stanford-Binet Test 





The Stanford-Binet Test of Intelligence, Form 
L, 1937 Revision, had been administered to all 
fourth grade subjects during their first year of 
school. The intelligence quotient range was from 
72 to 151. The mean and standard deviation were: 


1. Mean 
2. Standard deviation 


113. 05 
11. 62 


Relationships Among Abilities 





The findings from the instruments administer- 
ed to the 100 fourth grade subjects participating 
in the final survey were used to determine rela- 
tionships that exist among various abilities: 


1. Relationship between comprehension of 
verbal abstractions and background of 
information. 

. Relationship between comprehension of 
verbal intelligence and intelligence. 

. Relationship between abilities to classify 
and index ideas. 


The Pearson Products Formula was employed. 
A summary of relationships is presented in Table X. 


CONCLUSIONS 


Within the limitations of this study, the follow- 
ing conclusions appear to be valid: 


1. There is a high, positive relationship be- 
tween the comprehension of verbal abstrac- 
tions and background of information. 

a. There is a high, positive relationship be- 
tween ability to classify ideas and back- 
ground of information. 

. There is a high, positive relationship be- 
tween ability to index ideas and back- 
ground of information. 
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». The relationship between indexing abil- 
ity and background of information is 
slightly lower than the ability to classify 
ideas and background of information. 


2. There is a very high, positive relationship 
between the comprehension of verbal ab- 
stractions and intelligence. 

a. There is a very high, positive relation- 
ship between ability to classify ideas 
and intelligence, 

. There is a very high, positive relation- 
Ship between ability to index ideas and 
intelligence, 

*, The relationship between indexing abil- 
ity and intelligence is slightly lower 
than the ability to classify ideas and 
intelligence. 


. There is a very high, positive relationship 
between ability to classify and index ideas. 


IMPLICATIONS FOR PRESENT PRACTICES 


This study appears to have certain implica- 
tions for teachers in their guidance of compre- 
hension of concepts at different levels of com- 
plexity. 


1. Comprehension of concepts of science 
found in primary reading materials tends 
to be lacking in young children. More 
emphasis should be placed on developing 
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concepts that appear in primary science 
materials. 


. Comprehension of concepts is greater with 
pupils of superior intelligence than with 
those of average or low intelligence. To 
enhance conceptual comprehension for the 
average or ‘‘slow’’ learner, provision 
should be made to develop a background 
of experience for concepts found in instruc- 
tional materials. This may be achieved 
by providing experiences ranging from di- 
rect to vicarious ones. 


. Greater emphasis appears to have been on 
an inductive rather than deductive approach 
to comprehension of concepts at different 
levels of complexity. For increased com- 
prehension of concepts, deductive as well 
as inductive instruction should be provided. 


SUGGESTIONS FOR FURTHER STUDY 


1. Similar studies should be conducted at various 
grade levels. Further research could estab- 
lish the relationship between the comprehen- 
sion of verbal abstractions and intelligence. 


2. Several studies of this type should be conduct- 
ed at the college level to determine classify- 
ing and indexing ability of more mature stu- 
dents. This would be an additional index to 
the comprehension of concepts found in mater- 
ials at the college level. 
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A STATISTICAL ANALYSIS OF CERTAIN ED- 
UCATIONAL VIEWPOINTS HELD 
BY TEACHERS’ 


DAVID G. RYANS 
University of California at Los Angeles 


EDUCATIONAL VIEWPOINTS quite 
reasonably are presumed to be important factors 
in determining what shall be taught in the school 
and how it shall be taught. 

The composite of educational viewpoints, or 
educational philosophy, accepted by the superin- 
tendent of schools and his administrative staff 
(presumably with the approval of the school 
board and, in turn, reflecting the sentiment of 
the community) and applied with the cooperation 
of the teaching corps, determines the objectives 
of teaching to which the school system is com - 
mitted. It is expected that individual teachers 
will conduct their classes in keeping with indi- 
cated objectives. 

Of course, the educational viewpoints, or phil- 
osophy, of individual teachers may or may not 
conform to those of the school system in which 
the teacher is employed. Furthermore, because 
of lack of real understanding of the implications 
of the viewpoint held, or inability to trans late 
the viewpoints into classroom behavior, or per- 
haps external pressure to the contrary, a teach- 
er may not conduct his classes in keeping with 


the viewpoints he holds about educational matters. 


Nevertheless, in terms of probable inference, 
we would expect teachers committed to certain 
educational philosophies to behave differently in 
specified school situations than teachers com- 
mitted to other educational viewpoints. 

With such a postulate in mind—that teachers’ 
educational viewpoints are reflected in their 
classroom behaviors—the present study was un- 
dertaken in an attempt to better understand the 
organization of teachers’ educational viewpoints. 
Analyses were made to determine how certain 
viewpoints of teachers might be intercorrelated 
and the extent to which such viewpoints might be 
developed around some central core, or, on the 
other hand, might be characterized by multi-di- 
mensionality. 





Hypothesis 


It was hypothesized that the educational view- 
points of teachers tend to be organized into sev- 
eral relatively independent clusters with respect 
to academic achievement standards, curricular 
organization, pupil participation in class plan- 
ning, and similar matters—that a teacher’s 
viewpoints with regard to certain significant ed- 
ucational practices may bear little or no relation 
to his viewpoints regarding other significant prac- 
tices. 


Procedures 


To test this hypothesis: (1) two forms of an Ed- 
ucational Viewpoints Inquiry were constructed and 
administered respectively to elementary and sec- 
ondary teachers enrolled in summer session clas- 
ses in geographically scattered colleges of teach- 
er education; (2) responses to the Educational 
Viewpoints Inquiry were tabulated and tetrachor- 
ic intercorrelation coefficients computed between 
the items of each form (elementary form and sec~- 
ondary form); and (3) each of the two resulting 
correlation matrices (one based on the responses 
of elementary teachers and the other based on the 
responses of secondary teachers) was factor an- 
alyzed. 

The instrument employed for sampling educa- 
tional viewpoints, the Educational Viewpoints In- 
quiry, was a short form made up of 20 items, 
each item forcing a choice between contrasting 
viewpoints regarding educational practices. The 
form of the Educational Viewpoints Inquiry em- 
ployed with elementary school teachers is shown 
in Figure 1. 

As may be noted from Figure 1, items includ- 
ed in the Inquiry were devised to sample view- 
points with respect to: (1) curricular organiza- 





*#The analysis reported was carried out as one of a number of researches conducted in connection with the 
Teacher Characteristics Study. The Teacher Characteristics Study is a project of the Grant Foundation 
and the American Council on Education. ventral offices of the project are located at the University of 


California at Los Angeles. 
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Figure 1 


EDUCATIONAL VIEWPOINTS INQUIRY 
(Elem. ) 


(Spec. 6-1-50) 


Give your reaction to each of the following questions by marking an X in the box beside the response that 
most closely corresponds to your viewpoint. 


1, In your class do you prefer to have a penmanship period. 


( ) separate from the language expression period? 
( ) combined with the language expression period? 


. Do you believe that parent groups should 
( ) participate in planning the school program? 
( ) be well informed regarding the school policies, but not encouraged to participate directly in the 
program? 


. In planning units of classwork do you believe that 


( ) this should be largely the responsibility of the teacher ? 
( ) the suggestions should come principally from the children in the class? 


. In your class do you believe it is better to have 


( ) most of the reading content related to the language expression unit? 
( ) the reading work and the language expression work largely separate? 


. In your class do you believe it is better 


( ) to have several activities going on at once? 
( ) generally to have one activity in progress at a time? 


. In planning the social studies content for your class do you believe 


( ) the content should be prescribed and relatively closely followed? 
( ) considerable variation should be allowed in planning the content? 


. Is the average third grade child capable of ‘‘self-control’’ in the sense in which we usually use the 
term in referring to older persons? 


( ) Yes 
( ) No 


. In your class do you think it is better to have 


( ) the number work and the social studies work set up in relatively distinct units? 
( ) the number work closely related to the social studies unit? 


. Do you feel it is possible to develop most classwork around ‘‘out of school”’ activities ? 


( ) Yes 
( ) No 


. In your class do you believe the pupils learn to read more effectively in 
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( ) a single unified group? 
( ) several smaller reading groups? 


. In the third and fourth grades do you think it is preferable to have 


( ) special teachers for all art and music instruction? 
( ) art and music taught exclusively by the regular classroom teacher ? 


. If it were necessary to use a minimum school day for your class and you were free to plan the activ- 
ities, do you believe it would be better 


( ) to keep approximately the regularly allotted time for reading and number work, limiting some- 
what the time for social studies ? 


( ) to keep approximately the regularly allotted time for social studies, limiting somewhat the time 
for reading and number work? 


. Do you believe that parents should be permitted to visit classroom during regular class hours? 


( ) Yes 
( ) No 


. Do you feel that effective control of pupils in class can be achieved by making the class itself com- 
pletely responsible for such controls? 


( ) Yes 
( ) No 


. If it were necessary to use a minimum school day and you were free to plan the activities, do you be- 
lieve it would be better 


( ) to keep approximately the regularly allotted time for reading and number work, limiting some- 
what the time for art and music? 


( ) to keep approximately the regularly allotted time for art and music, limiting somewhat the time 
for reading and number work? 


. Do you believe that you should have considerable freedom to modify courses of study or units of work 
from class to class? 


( ) Yes 
( ) No 


. At the third and fourth grade levels do you believe 


( ) it is important to set and require relatively high standards of pupil achievement in the subjects 
taught? 
( ) academic achievement is relatively unimportant as compared with other objectives? 


. Do you feel that classroom responsibilities and administrative responsibilities 


( ) are fairly distinct and should be clearly defined and separated in the most effective school pro- 
gram? 


( ) overlap and should be participated in by all personnel regardless of particular assignments ? 


. In the third grade do you believe that home study supplementing and complementing classwork 


( ) is generally desirable? 
( ) is generally undesirable? 


. Do you believe that third grade children should 
( ) be required to meet prescribed academic standards before beginning the work of the fourth grade? 


( ) not be required to meet minimum standards of academic achievement before beginning fourth grade 
work? 
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TABLE II 


CENTROID FACTOR MATRIX (ELEMENTARY TEACHER SAMPLE) 














TABLE I 


ROTATED PRIMARY FACTOR MATRIX—OBLIQUE SOLUTION 
(ELEMENTARY TEACHERS) 
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tion and scope: (2) pupil participation in class 
planning; (3) academic achievement standards; 
(4) teacher -administrative responsibilities; (5) 
parent participation in the educational program; 
and (6) class, or course, planning and proced- 
ure. 

A number of item rationales, or hypotheses, 
were developed in each major category and ma- 
terials were selected for apparent representa- 
tiveness «nd significance. The items went 
through a number of revisions, based upon the 
experiences of respondents in pilot studies, un- 
til the phrasing and content seemed to conform 
to the purposes of the instruments. 

Each item in the elementary form of the Ed- 
ucational Viewpoints Inquiry had its approximate 
counterpart in the form employed for use with 
teachers of secondary school subjects. 

In the minds of the staff of the Teacher Char- 
acteristics Study the Educational Viewpoints In- 
quiry possessed satisfactory logical validity. No 
means were available to test the instrument em- 
pirically; at least, not in any direct manner. It- 
em analyses against somewhat removed external 
criteria related to certain aspects of teacher and 
pupil behavior i.e., pupil behavior in a teacher’s 
class, systematic and responsible classroom be- 
havior on the part of the teacher, sympathetic - 
understanding behavior of a teacher, etc. , were 
carried out for other purposes and most, but not 
all, of the items differentiated significantly be- 
tween criterion groups formed on the basis of 
classroon; observation. For the purpose of the 
present study such results (the correlation of 
responses to the Educational Viewpoints Inquiry 
with other criteria of teacher behavior) may be 


considered interesting but not of vital importance. 


The teachers’ anonymous expression of a view- 
point, when that expression is subject to no ex- 
ternal pressure, is probably as valid an indica- 
tion of what the teacher believes as can be ob- 
tained. 

In addition to the sampling of educational 
viewpoints, the Educational Viewpoints Inquiry 
included a number of ‘‘information,’’ or ‘‘identi- 
fication, ’' type items relative to the respondent’s 
sex, extent of teaching experience, extent of 
training, and the like. Such items provided con- 
trol data. 

The respondents contributing to this analysis 
did not write their name on the Educational View- 
points Inquiry or identify themselves in any way. 

The Educational Viewpoints Inquiry, in its 
two similar forms adapted for elementary and 
secondary teachers, was completed by samples 
consisting of 213 elementary school teachers and 
338 secondary school teachers during the sum- 
mer of 1950. The respondents were enrolled in 
the summer sessions at ten teacher education in- 
Stitutions in nine states ranging from California 
to Pennsyivania and Michigan to Florida. 
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Eight of the teacher education institutions were 
public universities, one was a state college, and 
one was a private university. The responses of 
both experienced teachers and teachers-in-train- 
ing were obtained. The ratio of experienced to 
inexperienced teachers in the samples employed 
was approximately 2 to 1. 

Upon receipt of the completed Inquiries, 2x2 
tables were set up for cross tabulation of the re- 
sponses and tetrachoric correlation coefficients 
were computed between each item and every other 
item of the Inquiry. This procedure was dupli- 
cated for the elementary teacher sample and the 
secondary teacher sample. 

Prior to the undertaking of factor analyses, 
the items and intercorrelations were reviewed 
and some eliminated due to disaproportionate ac- 
ceptance of one response over the alternative re- 
sponse. (For example, 330 of the 338 secondary 
school teacher respondents answered ‘‘yes’’ to 
the question: ‘‘Do you believe a high school in- 
structor should have considerable freedom to 
modify courses of study or units of work from 
class to class?’’ With such a split of responses, 
no meaningful relationship between this item and 
other items could be established.) Following this 
step, still other items were eliminated from the 
correlation matrices in order to maintain better 
numerical balance between the groups of items 
(i. e., curricular organization and scope, aca- 
demic achievement standards, etc. ,) and per- 
haps avoid artifacts in the factor analysis due to 
disproportionate representation of certain of the 
areas or groups of items. 

Eleven variables, then, (items 2, 3, 5, 7, 8, 
9, 14, 17, 18, 19, and 20) were included in the 
elementary correlation table, and 14 variables 
(items 1, 2, 3, 5, 7, 9, 10, 11, 12, 14, 17, 18, 
19, and 20) made up the correlation table for the 
secondary form of the Educational Viewpoints In- 
quiry. 

Factor analyses were accomplished by the 
centroid method described by Thurstone. 


Results 


Elementary Teacher Form of Educational 
Viewpoints Inquiry. —The intercorrelations be- 
tween responses of elementary teachers to the 
Educational Viewpoints Inquiry covered a wide 
range, from 0.01 to 0.56. Six centroid factors 
were extracted and subsequently rotated to oblique 
simple structure. 

The first factor seemed fairly clearly to have 
to do with emphasis upon the academic functions 
of the teacher—belief, perhaps, in the import- 
ance of the ‘‘fundamentals.’’ Factor 3 also 
seemed to reflect a so-called ‘‘traditional’’ sub- 
ject-matter curricular emphasis. Factors 1 and 
3 were correlated to the extent of 0. 44. 

Factor 2 had only two significant loadings. It 
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TABLE IV 


TRANSFORMATION MATRIX (ELEMENTARY TEACHER SAMPLE) 











TABLE V 


CORRELATIONS BETWEEN PRIMARY FACTORS (ELEMENTARY 
TEACHER SAMPLE) 
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TABLE VIII 


ROTATED PRIMARY FACTOR MATRIX—OBLIQUE SOLUTION 
(SECONDARY TEACHER SAMPLE) 





I Ii IV 





27 16 07 
35 26 -04 
00 -15 41 
07 17 -58 
-01 45 01 
-01 11 
16 48 
-33 23 
26 10 


13 “ii 
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TABLE Ix 


TRANSFORMATION MATRIX (SECONDARY TEACHER SAMPLE) 











TABLE X 


CORRELATIONS BETWEEN PRIMARY FACTORS (SECONDARY 
TEACHER SAMPLE) 
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appeared to have something to do with the teach- 
er’s democratic viewpoints toward parents and 
pupils and his willingness to recognize the pos- 
sible contributions of such persons. 

Factor 4 had only one significant loading, this 
having to do with belief in the desirability of home 
study. (This response also contributed signifi- 
cantly to factor 1. It seems doubtful that factor 
4 need be further considered. ) 

Factor 5 had only two significant loadings and 
was difficult to identify in terms of its psycho- 
logical meaning. 

Factor 6 appeared to be of no great signifi- 
cance, having no factor loading as high as 0.30. 

As has been noted already, the factors extrac- 
ted were correlated. The correlations between 
primary factors derived from the matrix trans - 
form suggest that while several clusters of view- 
points are statistically isolable, the most signif- 
icant data relative to an individual teacher may 
be a singie evaluation based upon such items as 
numbers 17, 18, 20, 3, 5 (negatively considered), 
and 8, the cluster apparently having to do with 
viewpoints accepting or rejecting subject-matter 
centered teaching and emphasis upon standards 
of achievement. Tables I through V show respec- 
tively the correlation matrix, the centroid fac- 
tor matrix, the rotated primary factor matrix, 
the transformation matrix, and the correlations 
between primary factors derived from the trans- 
formation matrix, based on the elementary tea- 
cher data. 

From Table II it will be noted that with very 
few items is any substantial amount of the vari- 
ance accounted for by contribution of the item 
to the several factors extracted. It would seem, 
therefore, that among the various issues about 
which elementary teachers form definite views, 
there is considerable specificity and relatively 
little tendency for the viewpoints to be system- 
atically interrelated, except perhaps with regard 
to the matter of academic emphasis. 


Secondary Form of the Educational Viewpoints 


Inquiry 


The range in magnitude of the intercorrelations 
between items comprising the secondary form 
of the Educational Viewpoints Inquiry was similar 
to that for the elementary form, the correlation 
coefficienis extending from 0. 02 to 0. 68. 

Again, six centroid factors were extracted 
and rotated to simple structure. The resulting 
factors were oblique and were even less well - 
distinguished from one another than those result- 
ing from the analysis of the elementary form of 
the Inquiry. 

Factor |i was fairly well-defined and appeared 
to have to Ho with subject-matter emphasis and 
academic gtandards—similar, it would appear, 
to factor :jof the elementary analysis. 
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Factor 2, stated negatively, seemed to be re- 
lated to the teacher’s belief that most course con- 
tent must be developed systematically around 
basic principles or facts rather than around ‘‘real 
life situations.’’ Factor 2 was correlated 0. 42 
with factor 1. 

Factor 4 seemed to be icentified with view - 
points that embrace singleness of purpose and 
‘‘taut’’ teacher control of the learning situation. 
This factor is related to factor 1 and also to fac- 
tor 2, correlations derived from the transforma- 
tion matrix being 0.57 in each case. 

Factor 6 is closely related to factor 1 and 4, 
there being a sharing of significant factor load- 
ings with respect to items number 10 and 11. If 
the factor loadings of items 10 and 11 are disre- 
garded, this factor might be described in nega- 
tive terms as having to do with approval of home- 
work for high school students. Factor 6 is cor- 
related 0.38, 0.27, and 0.47 respectively with 
factors 1, 2, and 4. 

Factor 3 is not clearly defined, but appears to 
be related to willingness to share responsibility 
and to accept the cooperation of others. 

Factor 5 seems to have to do with the teacher’s 
faith in the capabilities of his students and will- 
ingness to accept them as individuals. 

As in the case of the elementary analysis de- 
scribed above, the intercorrelations between the 
factors suggest that further combination of the 
items might reveal more satisfactory bases for 
individual evaluation than the obtained factor 
scores. Items 11, 12, 17, 19, 20, 9 (in negative 
terms), 3, 5 (negative), 10, and perhaps 19, ap- 
pear to form a somewhat meaningful pattern re- 
lated to subject-matter centered teaching andem- 
phasis upon standards of achievement. 

A second cluster of viewpoints, perhaps of 
minor importance, may be identified with factor 
5. 

Tables VI through X present the basic results 
showing respectively for the secondary teacher 
sample the matrix of correlation coefficient, the 
centroid factor matrix, the rotated primary fac- 
tor matrix, the transformation matrix, and cor- 
relations between the primary factors derived 
from the transformation matrix. 


Conclusions 


In general, it appears that the results of the 
factor analyses of elementary teacher and secon- 
dary teacher responses to the Educational View- 
points Inquiry support the hypothesis that teach- 
ers’ educational viewpoints are not highly sys- 
tematized or organized, although it is true that 
one or two constellations of viewpoints are sug- 
gested by the results. However, the relatively 
large amount of item variance that could not be 
accounted for in terms of group factors indicates 
considerable specificity on the part of the items 








December 1953) 


making up the Educational Viewpoints Inquiry. 

A composite score based upon responses to the 
Inquiry might reasonably be employed to indi- 
cate the general tendency of the teacher to asso- 
ciate himself with so-called ‘‘modern’’ educa- 
tional viewpoints as contrasted with viewpoints 
that sometimes have been called ‘‘traditional. ’’ 
Such a score might even have use in attempting 
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to place teachers in school systems with educa- 
tional philosophies more or less similar tothose 
held by individual teachers. But the results of 


the factor analyses presented here suggest that 
the viewpoints contributing to such a total score 


are fairly heterogeneous and tend not to be highly 
intercorrelated. 








CURRICULUM FOR PRIMARY TEACHERS’ 


SINA M. MOTT 
Southern Illinois University 
Carbondale, Illinois 


Introduction 


REALIZING THAT the personality and 
professional background of the primary teachers 
are important considerations, that there is need 
for healthy, vigorous teachers with friendly, 
cheerful personalities who have a sense of hum- 
or, who like children and who are liked by them, 
that there is need for well-groomed, intelligent, 
professionally minded ladies who are not only 
informed in their special field but see it in the 
total educational picture and interpret it toothers, 
and that there is need for alert teachers who, 
knowing modern trends, are able to work with 
parents and community for the best welfare of 
the child, —the student branch of the Associa- 
tion for Childhood Education at Southern Illinois 
University has made a study of nursery-primary 
curriculum. 


Statement of the Problem 





The three fields in which this research is 
conducted are: (1) What is the Felt Need of the 
Teachers Themselves; (2) What are the Require- 
ments for Certification; and (3) What is Being 
Offered in the Colleges and Universities. This 
last part is being omitted inasmuch as it seems 
impossible to obtain an accurate summary be- 
cause of the diversity of titles and variety of 
ways in which the courses are written up. 


Procedure 


1. What is the Felt Need of the Teachers Them- 
selves? 


The discovery of the felt need of the teachers 
proceeded in two steps. First, a study was 
made of the teachers of Southern Illinois who 
are working in the field, and second, taking a 
representative group of these teachers, a study 
was made of their activities from the time they 
awoke on Monday morning to the time they went 
to bed on Sunday evening. 

In order to gain a picture of the primary 
teacher in Southern Illinois, information onthree 
items was needed: (a) Are they single or mar- 
ried? (b) Do they have dependents? (c) Do they 
live ina room, an apartment, a home, or with 
parents? This study is made of four hundred 





twenty primary teachers, nursery, kindergarten, 
first, second, and third grade. Inasmuch as sou- 
thern Illinois has no large industrial section, the 
four hundred-twenty primary teachers in the 

towns and villages around Southern Illinois Univer- 
sity well represent the total number of primary 
teachers of ail southern Illinois. 

Are They Single or Married? —Of the four hun- 
dred twenty primary teachers, two percent are 
nursery teachers, 11 percent are kindergarten, 
31 percent are first grade, 30 percent are second 
grade, and 26 percent are third grade. They all 
teach in the public schools with the exception of 
the nursery teachers. 

All of the nursery teachers in this group are 
married. (It should be noted that the nursery 
schools are private.) There are 50 percent or 
half of both the kindergarten and the first grade 
teachers who are married, and 54 percent or more 
than half of the third grade teachers are married. 
Only in the second grade did we find fewer than 
half or 41 percent of the teachers married. Thus 
a program planned to meet the needs of the single 
teacher will not meet the needs of half the group. 

These figures emphasize the fact that to plan 
a curriculum to meet the needs of the primary 
teacher, we must plan for the married woman. 
More than that, we must provide refresher 
courses for those who, having been out of school 
a number of years, need to become acquainted 
with the best in methods. 

Do They Have Dependents? ——The dependents 
listed in order of frequency are: children, mother, 
father, both parents, and invalid husband. Where 
both the wife and husband are working, the hus- 
band is not considered a dependent. 

Fifty-eight percent of the four hundred twenty 
primary teachers are supporting or helping their 
husbands in the support of one or more individuals 
besides themselves. 

Those who plana primary curriculum to meet 
the needs of the primary teacher must take into 
account the fact that more than half of these girls 
will be either supporting or helping to support one 
or more individuals besides themselves. 

Those who plana primary curriculum to meet 
the needs of the primary teacher must take into 
account the fact that more than half of these girls 
will be either supporting or helping to support 
one or more individuals besides themselves. 

Where Do They Live? Only six percent of 





* A study made possible by a Kesearch Grant from Southern Illinois University. 





134 JOURNAL OF EXPERIMENTAL EDUCATION 


these teachers come from one room, and only 
five percent come from the parental home. It 
would be of interest to learn how many of these 
are aiding in the support of the parental home. 
Only nine percent come from apartments. (Re- 
member the study is made of teachers in south- 
ern Illinois where there are no large industrial 
areas.) By far the largest number, 80 percent, 
come stepping out of homes with market baskets 
ontheir arms. The traditional book bag has dis- 
appeared. 

The second step became that of determining 
how these primary teachers are able to be wives, 
mothers, daughters and housekeepers, besides 
teaching school for eight hours a day. In order 
to determine this, 37 kept a record of what they 
did each half-hour from the time they got up on 
Monday morning until they retired on Sunday 
night. This was done for one week by each of 
the 37 primary teachers. These 37 teachers 
were selected so that they represented the 420: 
four live with parents at home, two in rooms, 
four in small apartments, and 27 in their own 
homes. Looking at the group another way, five 


take care of one or both parents; six live alone 
(of which one contributes to the support of a son 
in college and another a parent ina sister’s 
home); nine live in homes where the husband is 
absent (in the army, divorced, or dead); and 


17 live with husband and family. The 37area 
cross section of the 420 primary teachers in 
southern Illinois. Each teacher recorded at 
half-hour intervals the activities in which she 
was engaged. The information from each of the 
37, for the seven days, was then combined. The 
data for Monday is in the Monday Time Schedule 
at the end of this article. 

For the sake of space and clarity, the num- 
ber doing each activity is not recorded here. Al- 
so it will be noted that often an activity carried 
over several half-hour periods. 

The morning activities which have been re - 
corded on the time schedules for the five days 
are much the same. They vary most in the ones 
for whom the primary teacher cares for before 
school: the baby, children, invalid mother, fa- 
ther, or husband; and in school: nursery, kin- 
dergarten, first, second and third grade. It is 
the time after school which varies more from 
teacher to teacher and from day to day. As the 
Monday schedule shows, Monday evening is 
largely spent in the home. Tuesday afternoon 
activities within the school building include fac- 
ulty meetings and conferences with parents or 
principal; while for the evening such activities 
as Sunday School parties, missionary meetings, 
Business and Professional Women’s Club, Am- 
erican Association of University Women, Re- 
becca Lodge, Association for Childhood Educa- 
tion, Extension class, kindergarten club, and 
primary teachers’ club are listed. Wednesday 
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follows the Monday pattern in that it is largely a 
home night. In the evening there are a few more 
church activities listed. The activity which char- 
acterizes Thursday as apart from Monday is clean- 
ing the cupboards, the kitchen, or the bathroom 
instead of the laundry or the ironing. The Thurs- 
day evening list includes: study for extension, 
reading, listening to the radio, playing cards or 
visiting. The morning activities for Friday may 
lock step with the other four days but recreation 
characterizes the activities from two o’clock in 
the afternoon through the evening. In school may 
be found Recreational Music, Story Hour, Indus- 
trial Art, Household Arts, and Free Activities. 
Among the evening activities may be found dinner 
out, movies, games with the children, beauty 
parlor, theater, card party with friends, and tel- 
evision with invited guests. 

It will be noted upon studying the Saturday 
Schedule that many of the activities which the gen- 
eral housewife does during the first six days of the 
week are crowded into Saturday. In order to do 
this, the housewife-teacher must be an expert in 
household management. She must be an efficient 
worker and a careful planner. 

With the stress of the week’s school and house- 
hold work behind them, these housewife-teachers 
(note Sunday Schedule) on Sunday become house - 
wives resting an hour longer before arising. But 
once up they carry through in the usual efficient 
manner, for Sunday finds 90 percent of these mar- 
ried and single teachers attending either Sunday 
school or church or both. Twenty percent of these 
work in some capacity as Sunday school teacher, 
organist, pianist, helper in young people’s activ- 
ities, or choir member. Planning for the whole 
of the primary teacher, Sunday worship and morn- 
ing devotions, as well as recreation, should be 
considered. 

These data which were recorded every half- 
hour from the time the primary teacher got up 
in the morning on Monday until she retired Sun- 
day evening may be summarized as follows: 


1. Personal 
1. Personal hygiene: soap, cosmetics, tooth 
paste, shampoo, home permanents 
2. Recreational: 
a. Reading (The group did not list what they 
read. ) 
. Music: organ, piano, voice 
. Radio, television 
. Movies, Theater 
. Games: with children, cards with adults 
. Correspondence 
. Clubs: American Association of Univer- 
sity Women, American Legion Auxiliary, 
Association for Childhood Education, 
Business and Professional Women, Re- 
becca Lodge, etc. 
3. Religious: daily devotion, church, Sunday 
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TABLE I 


NURSERY~-PRIMARY CURRICULUM 





Certification Requirements 
Listed as Subjects 


‘*Felt Needs’”’ Semester 
Listed as Content Hours 





Art and Music 
Music appreciation, piano 
voice 
Art 








Industrial Art 





English 
Written 


Oral 


World Literature 
Modern Literature 








Children’s Literature 





Health and Physical Education 
Body Health 





Physical Education 
Adult Games 





Children’s Games 





Human Development 


History 
Government 


Sociology 





Psychology 


Science 


Agriculture 
Botany, Biology 





Chemistry 
Household 


Physics 
Mathematics 


Religion 


General Education 


Simple melodies, rhythmic activities 

Knowledge and appreciation of old and new 
masters, design, sketching, painting, 
weaving (emphasis on creative art) 

Knowledge of tools, wood, metal, clay, 
leather 


Letters, articles (magazines, papers), radio 
scripts, stories, grammar, poetry 

Reports, story telling, choral reading, round 
table discussion, parliamentary rules, usage 
Essay, poetry, novel 

Essay, poetry, novel, knowledge of magazines 
(professional, literary) 

Stories, poetry, knowledge of magazines 


Hygiene of home, personal health, first aid, 
good grooming, morning inspection 
Gymnastics, callisthenics, dancing 
Basketball, soft and volley ball, square danc- 
ing, tennis, bowling, cards, checkers 
Rhythm games, outdoor games, indoor games 


Human race, national, state, province 

Group control, school room, national 

Family, neighborhoods, employment, race 
prejudice 

Mental abilities, laws of learning, retention, 
mental hygiene, etc. 


Gardens, pet husbandry, room plants 

Aquariums, herbariums, plants, flowers 
birds, insects 

Acids, alkalies, cosmetics, toilet articles, 
soaps, cleaning compounds 

Management, meal planning, marketing, sew- 
ing, laundry, cleaning 

Heating and plumbing systems, electric appli- 
ances, lighting 

Budgeting, taxes, insurance 


Daily devotions, Old Testaments, New Testa- 
ment 
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TABLE I (Continued) 





Certification Requirements 
Listed as Subjects 


‘*Felt Needs’’ 
Listed as Content 


Semester 
Hours 





4 
Human Growth and Development 





Child Deveiopment 





Child Psychology 





Teaching, Learning Techniques 
Reading 





Arithmetic 


Social Studies 





Science 


Public Education 





Student Teaching 





Electives 


Professional Education 


Family group, parental care, behavior 
patterns in physical, mental, social and 
moral development (birth to 3 years) 

Behavior patterns in physical, mental, 
social, and moral development (3 to 11 
years), guidance 


Experience charts, oral, thought, problems, 
phonics, vocabulary, printing, writing, 
book building 

Development of concepts, printing, drill, 
experience centered, practical use 

Agencies, institutions, leadership, cooper- 
ation 

Aquariums, herbariums, excursions 


History of education, philosophy, schoo} law, 
faculty meetings, professional organizations 


Nursery~primary level, participation: guided 
and full responsibility 
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school, Young People’s Meetings, Wom- 
en’s Missionary, Choir, Guild, Sunshine 
Club, etc. 


Il. Semi-Vocational 


1. 
2. 


Marketing: food, clothing, furniture, etc. 

Household Management 

a. Laundering, washing, ironing 

b. Cleaning: vacuuming, scrubbing, dust- 
ing, etc. 

c. Meal planning and cooking: breakfast 
lunch, dinner, supper, school lunches 
and teas. 

. Sewing, mending, embroidering, cro- 
cheting, etc. 

. Caring for heating and plumbing sys- 
tems 


Ill. Vocational 

Science: natural, social, physics, psy- 
chology (general and child) 

2. Art: music, fine and industrial arts 
3. 


a. 


English: literature, grammar, usage, 
journalism 


. Physical Education: Games, playground 


supervision 


. Arithmetic: primary (nursery to third 


grade), budgeting, taxes 


. Advanced Study Classes: correspondence, 


Extension, music 


. Professional Organizations: faculty meet- 


ings, Primary Teachers Club, Kinder- 
garten Club, Association for Childhood 
Education 
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2. What are the Requirements for Certification? 


The first step in this second part was that of 
writing to each of the forty-eight State Superin- 
tendents of Public Instruction for their certifi- 
cation requirements. Where a state does not 
have the primary certification requirements the 
one for elementary teachers was sent and is used 
in this study. 

The certification requirements, as set forth 
by the states, are tabulated and a curriculum 
containing those items which the majority include 
is constructed. The underscored curriculum re- 
corded in Table I is the summary of these find- 
ings. 


Summary 


The Student Branch of the Association for 
Childhood Education at Southern Illinois Uni- 
versity then made the summary of the certifi- 
cation requirements into a frame. Intothis 
frame they have written the ‘‘felt needs of the 
primary teacher’’. This is found on the right 
in Table I. 

This summary sheet was then checked by 80 
summer school students—primary teachers who 
came for summer school—at Southern Illinois 
University in the Primary Methods Classes. It 
is their decision that IF such courses as chemis-~ 
try, physics and mathematics will be reconstruc- 
ted to meet the ‘‘felt needs of the primary teach- 
er’’ it is alright to include them, but as they now 
stand in many colleges and universities they should 
be omitted and new courses constructed which will 
be of value to the housewife-teacher. 
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MONDAY SCHEDULE 
A. M. 


Arise and partly dress 
Fix breakfast and listen to radio 


Turn on radio for news 

Morning hymns 

Arise and prepare breakfast 

Eat and listen to news 

Dress and start breakfast 

Up and prepare breakfast for six 
Up and turn on heat 


Read Bible 

Prepare breakfast 

Pack three lunches 

Up and straighten house 

Up and dress 

Start coffee and read paper 
Eat and straighten room 


Eat breakfast 

Dress and prepare for school 
Feed dog and walk him 

Dress and feed baby 

Take daughter to University 
Prepare children’s lunches 
Lay out clothing for children 


Dress for school 

Start for school 

Breakfast 

Drive two miles for nurse 
Wash dishes and make beds 
Iron a blouse 

Straighten house 

Dress and make beds 

Take husband to work 
Leave for school 


Build fires at school 

Clean out furnace at school 
Dust and arrange room 
Prepare materials 

Drive three miles to school 
Finish dressing 
Preparation and inspection 
Take baby to mother 

Get the maid, go to school 


Prepare work for day 

Greet children, prepare work 
Supervise play 

Check workbooks 

Sell candy 

Supervise free play 

Wash Sue’s face and comb hair 


Wash Johnny’s feet and give him sox 
Send sick to nurse 

Inspect and sew button on child’s dress 
Inspect and call parents 


Opening exercises 
Inspection and call parents 
Inspection and order milk 
Music 

Reading, workbooks 
Reading and drill 

Reading and phonics 
Excursion 


Arithmetic and drill 
Excursion 

Arithmetic and science 
Science and art 
Demonstration lesson 
Industrial art and numbers 
Reading experience chart 
Music 


Numbers and recess 
Recess and health 

P.E. and Reading 

P.E. and science 

Recess and letter writing 
Recess and printing 
Morning lunch and rest 


Numbers and music 
Art and science 
Lunch and rest 
Recess and science 
Recess and milk 
Excursion 
Numbers and art 
Rest and numbers 
Recess and music 


Numbers and story 
Rest and numbers 
Science 

Excursion 
Experience chart 
Industrial art 

Art and numbers 


Numbers and science 
Industrial art 

Music and numbers 
Numbers and lunch 
Preparation for home 
Clean up room and lunch 
Industrial art and clean up 
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MONDAY SCHEDULE 


Lunch 

Prepare and eat lunch 
Home and lunch 

Shop and lunch 
Supervise lunch 


Lunch 
Supervise play 
Prepare for P.M. classes 


Reading 

Story 

Inspection and send to nurse 
Music and story 

Number work and drill 
Phonics and number 
Science and P. E. 

Resting and story 

Art and reading 


Industrial art 

Story and dramatization 
Music and dancing 

Art and music 

Science and art 
Excursion 

Printing and writing 
Writing and art 


Rest and lunch 
Rest and art 
Rest and music 
Free play 
Science 

Recess and art 
Excursion 


Rest and lunch 
Recess and art 
Recess and music 
Rest and art 
Science and P. E. 
Drill and music 
Prepare for home 
Clean up and leave 


Science 

Work period 

Industrial art 

Clean up room 

Prepare for next day 

Spelling and writing 

Close school 

Conference with parent 
Conference with principal 
Prepare for next day and leave 


MOTT 


P. M. 


Industrial art and spelling 
Spelling and music 

Preparation of room for next day 
Cleaning and leaving 

Conference 

Social studies 

Leave to shop 


Run errands, pay bills 
Postoffice 

Groceries 

Play with baby 

Get child from mother’s 
Rest 

Start supper 

Feed father 


Prepare room 

Clean and fix furnace 

Sweep and prepare for next day 
Gather children and go home 
Janitor work 

Kindergarten teachers’ meeting 
Faculty conference 

Go to postoffice 

Shop and go home 


Prepare supper and wash dishes 
Put away groceries and wash dishes 
Get groceries 


Eat 

Prepare supper 
Wash dishes 
Straighten house 
Groceries 


Supper 

Prepare supper 
Wash dishes 

Feed baby and eat 
Feed and walk dog 


Take nurse home 

Eat and wash dishes 

Start laundry in basement 
Play with baby 

Help children with school work 


Give small son bath 
Study for extension 
School work 

Sell tickets at school 

Sell candy at school game 
Iron 

Extension 
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MONDAY SCHEDULE 
P.M. cont’d 


Take baby to see grandmother 8:30 Plan meals for the next day 


Straighten up house 
Lay out clothes for next day 


American Legion Auxiliary 
Lay out clothes for morning 
Iron 

Laundry 

Prepare school work 

Put away laundry 

Sell tickets at school 

Sell candy at school 
Extension class 

Help boys with lessons 

Put baby to bed 


Laundry 

Prepare school work 
Extension class 
American Legion Auxilliary 
Study for extension 
Sprinkle clothes 

Sell tickets at school 
Sell candy at school 
Iron 

Radio, mend, read 
Lay out baby clothes 
Help children with bath 


Laundry 

American Legion Auxilliary 
Prepare work for school 
Read paper 

Sell candy at school 
Extension class 

Iron while listening to radio 
Radio and help children 
Radio and sew 


Write note for maid 
Help girls with baths 


Laundry 

American Legion Auxilliary 
Prepare for next day school work 
Extension 

Read paper and magazines 

Iron and radio 

Help girls with bath 

Prepare son for bed 

Plan meals 

Radio and rest 


Finish laundry 
School work 
Iron and radio 
Extension class 
Prepare for bed 


Take bath and pin up curls 
Prepare for bed 

Lay out clothes for family 
Prepare dress for next day 
Read and write letters 
Launder stockings and to bed 
Watch television 


Pick up around the house 
Launder stockings, etc. 
Bath and to bed 

Read the Bible and to bed 
Read and write letters 
To bed and read to sleep 


Retire 
Bath and to bed 
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SATURDAY SCHEDULE 


Arise and dress 
Turn on heat 


Start coffee 
Read paper 
Arise 

Eat 

Go for maid 
Launder 


Arise and start breakfast 
Prepare breakfast, radio 
Laundry, start coffee 
Eat, Laundry 


Eat breakfast 

Dress, put on coffee 
Prepare breakfast 
Laundry 

Arise, prepare breakfast 
Feed baby, dress her 


Wash dishes, launder 
Breakfast 

Change linens 

Launder, prepare breakfast 


Launder, beds 

See that son gets dressed 
Wash dishes, laundry 

Wash dishes, laundry linens 
Pin up hair 


Rest 

Wash dishes 
Dinner 
Shopping 
Prepare lunch 


Rest 

Play outside with baby 
Wash dishes 

Shopping 

Dinner 

Clean house 


Plan school work 

Put baby to rest 
Shopping, visiting 
Rehearse vocal lessons 
Shopping 

Bath, dress 

Wash windows 


MOTT 


A. M. 


Laundry, dishes 

Clean kitchen, defrost refrigerator 
Scrub floor, hang clothes on line 
Shampoo girl’s hair, put it up 
Shop 


Shop 

Change linen, laundry 

Clean house, radio 

Shampoo girl’s hair, pin it up 


Shop 

Clean bathroom, watch child 
Clean house, start dinner 
Change linens, radio 


Put groceries away 

Read, rest 

Clean house, supervise son’s play 
Clean house, start dinner 
Shopping 

Postoffice 

Prepare lunch 


Prepare lunch 

Clean house, supervise son’s play 
Clean house, radio 

Dress to go to bank 

Service station for gas 


Eat, shop 
Prepare lunch 


Plan school work 
Clean house 
Shopping 

Visiting 

Baking for Sunday 
Take maid home 
Take girls to movie 
Shampoo hair 


Plan school work 
Clean house 
Shopping 

Visiting 

Baking for Sunday 


Bath, dress 

Put away clothes 
Shopping, cleaning 
Baking for Sunday 
Lunch 
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SATURDAY SCHEDULE 
P.M. cont’d 


Shopping with friends 
Ironing 

Visiting 

Practice on piano and organ 
Read papers 

Clean porch, steps, etc. 


Shopping with friends 

Dress baby and give her juice 
Visiting 

Practice on piano and organ 
Ironing 

Pick up girls and take them home 
Cleaning 


Shopping with friends 

Take baby shopping 
Visiting 

Practice on piano and organ 
Ironing 

Bath, dress 


Shopping with friends 
Shopping with baby 

Visiting 

Practice on piano and organ 
Take dog out 

Plan Sunday dinner 

Bathe and dress son 


Dinner out 
Shopping with baby 
Visiting 

Dinner 

Radio and mend 
Rest, read 
Prepare dinner 


Dinner out 

Dinner, prepare, eat 
Care for father 
Radio and mend 
Company 

Prepare supper 


Dinner out 
Dinner 
Prepare supper 
Radio, mend 
Wash dishes 
Company 

Play with baby 


Dinner out 

Dinner, wash dishes 
Supper, radio 

Radio, mend 

Read and play with baby 
Company 


Cards and visiting 

Clear table and wash dishes 
Iron dresses 

Study Sunday School lessons 
Take baby to grandmother 


Cards and visiting 

Play with son and baby 
Plan Sunday with husband 
Wash dishes, read 


Cards, visiting 

Put to bed son, baby, girls 
Sunday School lessons 
Read paper 

Radio, television 


Entertain 

Cards, visiting 

Movie, television 

Check clothes for Church 
Sunday School lessons 


Entertain 

Cards, visiting 
Movie, television 
Bathe and go to bed 
Visit with husband 
Sunday School lesson 


Cards, visiting 
Entertain, television 
Movie, radio 

Visit with husband 
Read, go to bed 


Home reading 
Entertain, movie 
Television, radio 
Bathe and go to bed 
Visit with husband 


Bed 
Entertain, radio 
Movie, television 
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SUNDAY SCHEDULE 
A. M. 


Turn on heat 
Arise and dress 


Dress 

Prepare breakfast 
Sprinkle clothes 
Clean room 


Read paper 

Breakfast 

Feed father 

Wash dishes 

Make beds 

Study Sunday School lesson 
Arise 


Read 

Sleep 

Dinner 

Feed father 
Wash dishes 
Radio 

Put baby to bed 


Read 

Sleep 

Iron son’s clothes 
Read Sunday paper 
Wash dishes 


Driving 

Visiting 

Reading 

Wash dishes 
Straighten up house 
Television 


Visiting 

Driving 

Radio 

Television 

Study extension 
Read Sunday paper 
Visit grandmother 


Prepare supper 
Radio 
Visiting 


Dress for church 
Wash dishes 
Dress baby 


Sunday School lesson 
Teach class 
Dress for church 


Church 
Play organ 


Dine out 
Prepare dinner 


Study extension 
Visit grandmother 


Supper 

Radio and play with baby 
Visiting 

Wash dishes 

Feed father 

Television 

Walk dog 


Reading and visiting 
Planning for next week 
Radio, church, canasta 
Eat left overs from dinner 
Wash dishes and television 


Planning for next week 

Radio, church, movie 

Church, bathe baby and put to bed 
Church and Young People’s Meeting 
Television 


Planning for next week 
Church 

Radio, visit with husband 
Fix fires for the night 
Put girls to bed 

Movie and bed 


Bed, radio 








A SIMPLE COURSE EVALUATION SCALE 


RALPH MASON DREGER 
Florida State University 
Tallahassee, Florida 


Introducation 


ALTHOUGH teachers and administrators have 
long been aware of the need to evaluate courses 
to determine the effectiveness of methods, tea- 
chers, and materials utilized in the curriculum, 
there still exists a demand for methods of eval- 
uating college-level courses. (4) Among other 
endeavors to meet this demand one of the most 
promising is the large scale program of evalua- 
tion in the General Education movement under 
the leadership of Dr. Paul Dressel. The results 
of this program should be of value to ‘those in 
and out of the General Education movement. (6) 

The evaluation scale described in this article 
was originally constructed on the basis of the 
general need for evaluation mentioned above as 
well as in answer to personal needs of an in- 
structor. Other scales have been developed 
which are more adequate from some standpoints; 
Amatora’s (1) technique for evaluating teachers 
for example, could be generalized beyond the 
grade school level on which it was standardized. 
The value of the scale presented here has been 
found to reside in its simplicity, its ease of ad- 
ministration, its production of frank judgments 
on the part of students, and to some extent its 
statistical manipulability. 

Any college or university class whichemploys 
some combination of lecture and discussion 
methods can use the scale. And any teacher can 
get the trends represented in his class if he 


knows how to take a mean and standard deviation. 


The writer has utilized the technique over a per-~ 
iod of several years and in two different school 
situations. Also, a group of teachers in anarea 
of General Education employed it to make statis- 
tical comparisons among their various classes. 
Other individual teachers have made use of it. 
The scale is administered as a separated ad- 
dendum to the final examination. That is, the 
sheet containing the scale is handed out immed- 
iately after the final examination is distributed 
with the request that students fill it out, but that 
they place the sheet in a separate pile and in dif- 
ferent order from the examinations. Emphasis 
is laid on the necessity for, and precautions are 
taken to preserve, anonymity. In the section on 
‘‘Qualitative Uses’’ a further statement is made 
concerning the frankness of expressed feelings 





obtained by the scale under these circumstances. 

Recognition is fully accorded to the need for 
other forms of course evaluation. The present 
scale is offered as only one means of evaluation, 
albeit an important one, the student’s frank rating 
of important factors in the course. 


The Scale 


Graphic rating scales have been found to be 
satisfactorily reliable and easy to use. (5, 7) 

The ‘‘Student’s Evaluation of Course’’ is a simple 
graphic rating scale with students acting as 
‘‘judges.’’ Figure 1 presents the latest revised 
version of the scale. When a supplementary text 
is employed, a third item between Numbers 2 and 
3 has been included. (See page 147.) 

Also, in item Number 6 (Number 7 if the sup- 
plementary text item is included) the statement 
was changed for one term to: ‘‘The course has 
made a change in my philosophy of life.’’ From 
student comments the wording in Figure 1 appears 
to be preferable. 

On the whole, the use of an invitation to make 
comments, following item Numer 6, has proven 
to be more productive than merely leaving the 
space blank with no suggestion. 

Items Numbers 4, 5, and 6 are purposely set 
up to indicate a balance if the student feels the 
course is balanced. Varying of the ‘‘most favor- 
able’’ point is also intended to avoid the tendency 
to make a mark on each line at about the same 
place. The influence of the totality of the course 
and the instructor cannot help being felt from one 
item to another, though the ‘‘halo effect’’ appears 
to be less than might be expected in such a scale 
as this one. (See section on ‘‘Quantitative Uses.’’) 

Though the writer is aware that the scale as 
set up violates several principles considered best 
for rating scales (5), in particular, using defin- 
ite marks along the rating line, and not having 
descriptive phrases between the extremes, the 
purposes of the scale were held more important 
than these considerations. It was thought, pos- 
sibly unjustifiably, that the use of marked points 
wouid encourage use of any part of the scale rather 
than just the white space in the middle. And since 
the scale is meant for a quick expression of feeling 
at the close of the final examination when time is 





of the essence, the fewest descriptive phrases 


* The author wishes to express his thanks to the Psychology Seminar of Florida State University, and espec- 
ially to Dr. Theron Alexander, Jr., Dr. Howard Baker, and Dr. Anders Sweetland, for helpful sugcestions 


and criticisms. 
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Student’s Evaluation of Course 





Name of Course 





Please give your best judgment on the following items. Do NOT sign your name, Check on 
each scale where you feel the right place of tmphasis is. 


The material presented in the course as a whole is: 


Very helpful Not helpful at all 
! 





— * ee | 


The Text is: 


Very helpful Not helpful at all 


LL. 1 1 L = 





The lectures are interesting or not: 


Stimulating Very dull 


L 





_ * 


The amount of work required for the course was: 


Too little 


L L 1 i 


Too much 


1 





The balance between lecture and discussion has been: 


Too much lecture Too much discussion 


i ofl 4. = 1 L 1 





The course has made a change in my thinking or philosophy of life: 


Profound change No change at all 


L =e l i 





FEEL FREE to use the space below to make comments on any of the above questions: 





Figure 1 


Sample of the Evaluation Scale 


(Centered on 8 x 11 mimeographed sheet. Division points are at each eleventh space. ) 
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DREGER 


3. The Manual, Workbook, or Prospectus is: 


Very helpful 


1 


Not helpful at all 
Re 


_— | 





consonant with clarity had to be included. 

An odd-numbered point scale has been ques- 
tioned at times on account of an alleged tendency 
for scores to group toward the midpoint. This 
difficulty does not seem to be great in actual prac- 
tice with this particular scale. In both the 
writer’s and others’ classes students have made 
their choices at the ends of the scale where they 
seem to feel their choices should be. Means of 
distributions have differed significantly from the 
midpoint again and again. In other research the 
writer has utilized an eight-point scale and has 
found no manifest differences between sevenand 
eight points. 

Scoring has been done in tenths of a point, 
ranging from 1.0 to 7.0. The score is taken 
where the point of the check-mark (/) or the 
crossing of the X (x) is found. Where the stud- 
ent has written a word or a group of words, ra- 
ther than making a mark, the midpoint of the 
word or words has been scored; one is not con- 
fronted with this exigency very often. A sugges- 
tion is made by Guilford (5) that scoring units be 
smaller than scale units. No doubt, however, 
tenths of a point are too refined. Yet most stud- 
ents do not mark the scale compulsively at the 
points printed on it, so some smaller division 
than whole numbers is needed. A marking key 
has been utilized at times; estimation of tenths, 
however, fairly accurately determined without 
a key, is recommended, egpecially in light of 
the possible over-refinement of scoring units. 

As far as the writer is concerned, this eval- 
uation scale may be copied by anyone to be used 
in classes. If users care to report on their re- 
sults, such a report will be appreciated in order 
to add to validational materials. 


Quantitative Uses 





Direction of Attitude—The first use which the 
writer found helpful is to determine the direc- 
tion of attitude of a class. A mean or median, 
depending on the form of the distribution, can 
show where the class as a whole is tending. 
Standard deviations and ranges show how widely 
the group may differ from one another. A con- 
venient adaptation of a bar graph helps here. 
Figure 2 gives an example of this kind of graph. 








It is easy to utilize one of the mimeographed 
evaluation sheets to exhibit mean, standard dev- 
iation, and range. 

A suspicion may obtain in connection with it- 
tems Number 1 and 3 that the ‘‘halo effect’’ could 
very easily operate. The course and the instruc~ 
tor may be read in terms of each other. Neverthe- 
less, Pearson product-moment correlation coef- 
ficients between items Number 1 and 3 from two 
groups representing two different schools were 
.508 and .270 respectively, with the latter not sig- 
nificant. These correlations were in line with ex- 
pectancy, since the first group consisted mostly 
of freshmen who would be expected to be less dis- 
criminating than the second group consisting of 
relatively mature students. Only twenty-five per- 
cent of the variance in item Number 1 is account- 
ed for by variance in item Number 3 in the first 
group of students. 

A bigger question may be asked, perhaps the 
most relevant one, ‘‘Does the scale actually show 
a difference of attitude from one situation to an- 
other?’’ That is, is direction of attitude actually 
differentiated, or do all classes in all situations 
mark the scale similarly? The answer is that it 
has shown significant differences among courses 
and between objectively varying situations. 

The group of teachers mentioned in the Intro- 
duction found statistically significant differences 
among their courses.* Tables I and II present 
an analysis of variance of both courses in the Gen- 
eral Education area involved. Table I gives the 
analysis of both courses together on all items, 
Table II of each course separately on item Num- 
ber 1, the ‘‘overall item. ’’ 

Even though, however, the scale does manifest 
differences where one might expect them to be 
found, it is consistent in respect to courses taught 
by the same teacher. In the group comparisons 
above, classes taught by the same teacher did not 
differ significantly from one another in spite of 
fairly large differences among classes taught by 
different instructors. In another case, in the fall 
of one year one teacher taught a course in Person- 
al Development to freshmen mainly, a course in 
General Psychology to regular students in a uni- 
versity, sophomores and above, and another Gen- 
eral Psychology course to an Air Force night 
class at an air base. As Table III indicates, no 





* The variance on item Number 6 is usually considerably higher than on any other item. 


(Cf. Table I) 


Students may differ widely in their interpretation of this item, or are forced by the scale to make 
more discriminative judgments on this item. The item's validity may be questioned if the former al- 


ternative holds, 
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Neme of Course 





Please give your best judgment on the following items. Do NOT 
sign your name. Check on each scale where you feel the right place 
of emphasis is. 


1. The material presented in the course as a whole is: 


very helpful Not helpful at all 
' 


The Text is; 


Very helpful | Not helpful at all 
' ' 


The lectures are interesting or not: 


Stimulating | Very dull 
' ' 


The amount of work required for the course was: 








Too little 
' ' 





The balance between lecture and discussion has been: 


Too mech lecture | ™oo mich discussion 
' ' 


The course has made a change in my thinking or philosophy of life: 


Profound change | No change at all 
' ' 


FEEL FREE to use the space below to make comments on any of the 
above questions: 











Figure 2 


Bar Graph Depicting Mean (vertical line), Standard Deviation (heavy bar), and 
Range (light bar) on Each Scale Item 





December 1953) DREGER 


TABLE I 


ANALYSIS OF VARIANCE OF SCORES IN TWO COURSES ON 
ALL ITEMS OF SCALE 





Source of Sum of Degrees of Mean 
Item Variation Squares Freedom Square F Ratio* 





i. Between groups 68. 63 8 . 58 6. 86 
Within groups 571.20 458 . 25 


Between groups 110. 89 8 . 86 10. 66 
Within groups 583. 91 450 . 30 


Between groups 110.57 8 . 82 12. 68 
Within groups 481.37 443 . 09 


Between groups 40. 79 8 .10 5.73 
Within groups 397.14 448 . 89 


Between groups 48. 41 8 . 05 9. 76 
Within groups 274. 37 440 . 62 


Between groups 223.14 8 . 89 
Within groups 1002. 98 455 .20 





* All ratios in this column are significant at the 1% level. 
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TABLE I 


ANALYSIS OF VARIANCE OF SCORES IN TWO COURSES ON ITEM NUMBER 1, 
COURSES SEPARATED 





Source of Sum of Degrees of Mean 
Course Variation Squares Freedom Square F Ratio* 





A. Between groups 33.97 5 6.79 4.96 
Within groups 388. 62 284 1.37 


Between groups 25. 16 2 12.58 11. 98 
Within groups 182. 58 174 1.05 





TABLE Il 


ANALYSIS OF VARIANCE OF SCORES ON ITEM NUMBER 1 IN THREE 
CLASSES TAUGHT BY SAME TEACHER 





Source of Sum of Degrees of Mean 
Variation Squares Freedom Square F Ratio* 





Between groups 6. 99 2 3.50 2.99 


Within groups 164. 88 1.37 





* Ratio is not significant. 
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significant difference showed up on item Number 
1 among these exceedingly diverse groups. 


Chronological Trends 





While at any one time the scale is consistent 
for any one teacher, during the several years 
that the writer has employed the ‘“‘Student’s 
Evaluation of Course’’ trends have been man- 
ifested on the scale which are validated by the 
external circumstances. It was predicted that 
during the terms in which he was writing his dis- 
sertation the writer’s scales would showatrend 
away from the normal, inparticular, higher means 
on item Number 1. Figure 3 makes some case 
for the way in which the prediction was borne out. 

Comparable classes across a period of a num- 
ber of quarters and semesters gave mean scores 
which are represented in toto by a linear regres- 
sion line with a slope of -.04. Without the mean 
score in the term devoted least to class prepar- 
ation, the line has a slope of -.06. The first 
mean represents the first term the writer taught 
on a college level. The other means, apartfrom 
those in the dissertation period, show a consis- 
tent average. On the other hand, if one takes 
only the points between the first mean and the 
highest (which deviates from the others because 
of external circumstances, the author believes), 
the parabola which almost perfectly fits these 
points does seem to represent an actual trend of 
scores. The external situation is a verifiable 
one; the scores appear to follow the objective con- 
ditions. If the extrapolated means actually rep- 
resent the trend, one can be thankful no further 
terms had to be devoted to dissertation writing. 

Whatever function fits the points, the 2. 86 at 
least appears to be out of place. A standard er- 
ror of estimate calculated including 2.86 is .241; 
without 2. 86 it is .158. Inthe latter case, 2.86 
lies 3.675 standard errors of estimate above 
the predicted score, considerably beyond the one 
percent level of chance expectancy. 


Group Comparisons 





It is usually difficult to get teachers to have 
statistical comparisons made on their classes; 
nevertheless, the scale is useful for such pur- 
poses. Tables I and II offer examples of the pos- 
sibilities here. It does seem that for the scale 
to be of full benefit here the teaching staff has to 
sit down with the results and face them honestly. 
Such a procedure was followed by the group of 
teachers mentioned previously. The results were 
presented as objectively, and diplomatically, as 
possible. Discussion included an explanation of 
the limitations of such scales as well as their 
values. Possibly most groups could not be as ob- 
jective as this one was. If not all members ofa 
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staff agree on common discussion, an administra- 
tor with the consent and cooperation of his teach- 
ers could use the scale and keep its results con- 
fidential. Odious comparisons, first, and com- 
plete dependence, secondly, on any one form of 
evaluation, are, of course, to be avoided. 


Qualitative Uses 





It is of no help to the students involved, for they 
of necessity remain unknown; but on item Number 
6 it is revealing to find there area few ineachclass 
who check the very extreme at either end. From 
a clinical standpoint, these extreme scores usual- 
ly mark some kind of instability. It may be that 
honestly a person has had such a profound change 
that he would mark all the way to the left; yet it 
is not ordinarily expected that anyone willso mark. 
If, however, a student marks all the way to the 
right, one can surmise that he is fighting against 
the teacher, the course, or both. Any honest ap- 
praisal of any course, it would seem, should in- 
clude recognition of some slight change in one’s 
philosophy of life. It is wholesome for a teacher 
to realize that there may be someone who has 
been influenced strongly enough to be very much 
moved for or against his course. 

Validation of the honesty of the ratings, which 
to an extent is a validation of the scale itself, since 
the student is supposed to mark what he feels about 
the course, not what the objective value of the 
course actually is, is found in the written com- 
ments at the bottom of the page below the scale it- 
self. Following are some examples taken from 
various courses: 


‘‘Regarding no. 5 particular teacher required 
2, 2000 word research papers for a 2 hour course. 
All others required only 1.’’ (This person meant 
Number 4. ) 

‘‘This course was very stimulating. ’’ 

‘‘The time consumed in connection with the 
term paper is not worth the value received from 
the paper. ’’ 

‘‘The text is mediocre, gives many examples 
in place of explanations. Read too much to gain 
too little, ’’ 

‘Lectures were too deep for class. ’’ 

‘Enjoyed this course more than I do my other 
ones. ”’ 

‘*] don’t think that this course should be re- 
quired. ’’ 

‘‘Good course—and good instructor! ’’ 

‘‘The workbook was unnecessary. It only made 
me get mad at some of the questions I couldn’t 
answer and took up too much time when the text 
was taking up enough. ’’ 

‘‘] feel that it was too general or hasty and it 
was a complete waste of time. I do not think I 
got much of anything from it. ’’ 
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‘*T have enjoyed this course very much. Dr. 
Blank is very good a very intelligent person— 
a very pleasing personality. ’’ 


Obviously, these students felt that their ident- 
ity could not be established. There are enough 
of these comments in every set of scales to im- 
press one with the student’s belief that he isanon- 
ymous and can express himself honestly. 

One advantage which cannot be directly meas- 
ured, but may be inferred, is that students who 
have not had a chance to ‘‘gripe’’ are givena 
chance without fear of retaliation. On the other 
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hand, those students who desire sincerely to 
express their appreciation for a course can like- 
wise have their say without fear of being misun- 
derstood. 


Summar 

A course evaluation scale has been described 
which is simple to use and to assess, Its quan- 
titative uses are to show the direction of attitude 
of classes, chronological trends, and possibly 
group comparisons. Extremes of attitude can 
be found. The frankness of the use of the scale 
by students has been suggested. 
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“RESISTANCE TO EXTINCTION” OF TWO PAT- 
TERNS OF VERBAL REINFORCEMENT 


E. VICTOR MECH* 
Indiana University 
Bloomington, Indiana 


THERE ARE apparent two broad classes 
of responses in the area of conditioning. Those 
responses, conditioned or unconditioned that 
are elicited by specifiable stimuli are calledre- 
spondent (Pavlovian conditioning). The other 
class, comprising all those responses that are 
emitted more or less independently of identifi- 
able stimuli, may be referred to as operant. 

Clearly, most of our behavior in the 
routine affairs of everyday life is operant, in 
that it operates or acts upon the envirunment to 
produce the satisfaction of basic ‘‘needs. ’’ Re- 
spondent behavior is much less commonly ob- 
served and seldom, if ever, operates upon the 
environment to produce anything. 

Skinner (1938) worked exclusively with the 
rat, reinforcement depending upon the rat press- 
ing the bar in the Skinner-box apparatus. Bar- 
pressing in this situation is an operant. Itoccurs 
with a low frequency prior to any experimental 
procedures that may be applied. Its strengthis 
increased when it is followed by reinforcement. 
Increased strength means merely that it occurs 
with higher frequency than it did before. 

Probably the best measure of operant strength 
is frequency of occurrence. Anoperant is 
strong when emitted often within a given period 
of time; it is weak when emitted rarely. 

A paradigm suitable for Type R conditioning 
is shown, along with the familiar Type S schema. 
A comparison of the two will help clarify some 
of the ways in which the two types differ. (For 
the purpose of this paper let us assume a two- 
factor theory as do Skinner and Mowrer. Hull 
(1943) disputes the theory that there exists two 
types of learning. Fundamentally, Hull attempts 
to handle both under his set of postulates. ) 


Type R: (Skinner) 
s. . . .R(bar pressing)—+*S (food) —+R (eating) 


Type S: (Pavlov) 





S (food) > R (salivation) 


S (tone) er r (ear twitching) 


> 








Type S conditioning involves the elicitation of a 
response (salivation) by an identifiable condition- 
ed stimulus (tone) that is under the experiment- 
er’s control. In Type R conditioning, the specific 
stimulus that initially evokes the response (bar 
pressing) cannot be identified. This is indicated 
by the small s of the Type R paradigm. 

For all practical purposes, the response is 
initially emitted, without recourse to any specific 
stimulus source. 

Type S conditioning involves stimulus substitu- 
tion and the formation of a new reflex. The tone, 
in the classical Pavlovian example, comes to act 
as a ‘‘substitute’’ for food in eliciting salivation; 
and tone~salivation is the new reflex. In Type R 
conditioning, however, there is merely the strength- 
ening of a reflex that already exists in the organ- 
ism’s repertory. Bar-pressing, for example, 
occurs in a Skinner~box with some frequency prior 
to any reinforcement with food. At any rate, no 
substitutionis involvedand no new stimulus-re- 
sponse relation is formed. 

This brings us to a focal point in educational 
research. At least one educational psychologist 
(Stroud, 1951) has recently made more than pas- 
sing reference to the need for a systematic behav~- 
ior theory in education, as follows: 


Undoubtedly, one of the pressing needs 
in our field is a comprehensive learning 
theory (or behavior theory) that will encom- 
pass teaching and learning in school and 
embrace the broad phenomena of personal- 
ity and adjustment A frank attempt to 
extend the current learning theory of Hull, 
Tolman, or others, to learning in school 
is overdue... (p. 282) 


On the other hand, Brownell (1948) points out the 
futility of attempting to base school practice on 
any contemporary learning theory. The school 
situation, according to Brownell, involves inter- 
action of many factors, and so does not follow 

the simple model of the laboratory experiment. 
Brownell also stresses that educational psychol- 
ogy is not an attempt to apply psychological learn- 
ing theory to education; rather, research must 





*The author wishes to express his gratitude to both Dr. Wendell W. Wright, Dean, School of Education, and 
Dr. Nicholas Fattu, Director, Institute of Educational Research, Indiana University, for their continu- 
ing support of basic experimentation. 
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develop educational principles out of studies of 
real school problems in their natural complex 
setting. 

It is evident, however, that the theoretical- 
experimental psychologist who utilizes infra- 
human organisms and performs operations on 
them, does not, indeed, observe them in their 
natural complex setting. Actually, many inves- 
tigators favor the results of relatively simple 
experiments upon infrahuman organisms as the 
principal inductive base for learning theory. 
This preference is not due to any over simplified 
belief that all of the principles which may event- 
ually be needed to account for complex behaviors 
can be derived from these experiments, but 
rather to a conviction that only from these ex- 
periments can there be confidence that the ef- 
fects of different variables have been isolated. 
Thus it is difficult to believe that the beginnings 
of an adequate theory can take root from any - 
thing but an exhaustive analysis of experiment- 
ally isolated situations. With respect to educa- 
tional theory then, it appears to be contingent 
upon the educational psychologist to utilize test- 
able principles derived from infrahuman studies, 
and to perform operations upon human subjects 
in the relatively ‘‘simple’’ laboratory situations. 

Although the stated educational aims are di- 
rected toward explaining how human organisms 
learn, there has been in vogue an emphasis up- 
on educational tests. There are thousands of 
test titles, which the testers have limited their 
collection of facts to the marks put on the papers 
by persons being tested, and to the association 
of these marks with some criterion which usu- 
ally has succegs in school as its only referent. 
Although the testing movement is highly useful 
and practical, it has, unfortunately, not contrib- 
uted to psycho-educational theory. Indeed, it 
has not advanced our knowledge in explaining 
how the human learns. 

Clearly, then, a behavior theory for educa- 
tion should take behavior as its datum. The 
primary nature of the paper is to suggest a di- 
rection for the experimental educators to pro- 
ceed toward this goal. 

There: has been much work done with the white 
rat employing the concepts of ‘reinforcement’ 
and ‘extinction’; unfortunately, there is a lack of 
systematic data on the human level. 

Jenkins and Stanley (1950) point out that the 
regular reinforcement of response is, indeed, 
not the world’s rule; and this leads us into an 
extremely interesting area. There are various 
schedules of reinforcement that can be adminis- 
tered in the laboratory; for the purpose of this 
experiment, however, only two were utilized: 
Continuous reinforcement and partial reinforce- 
ment. That is, every time in acquisition anS 
in the continuous reinforcement group gave a 
response belonging to the ‘‘correct’’ class, a 
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‘‘reinforcement’’ was received. In the partialre- 
inforcement group, the Ss received reinforcements 
only 50 percent of the time, or for every other 
‘‘correct’’ response. The reinforcement sched- 
ules apply only to the acquisition phase of the ex- 
periment. Once the acquisition criterion was 
reached each S was placed on 5-minute extinction. 
(Absence of reinforcement. ) 

In measuring the resistance to extinction, the 
ratio of the number of correct responses to the 
total number of responses for 5 minutes was used. 
The number of responses in a complete extinction 
is generally more satisfactory, since any short- 
time criteria excludes possibly important data 
contained in the rest of the extinction curve. On 
the other hand, extinction criteria have the advan- 
tage of being time-saving and experimentally con- 
venient, and are therefore frequently employed. 


Procedure 


Upon entering the experimental room each 8 
was told to read aloud the following printed in- 
structions: 


The task in the experiment is a simple 
one. All you are to do is to continue say- 
ing out loud any numbers that you wish. It 
is important that you continue this opera- 
tion until the experimenter tells you tostop. 
You will be told when the numbers you are 
saying are on the ‘‘right’’ track. Attempt 
to say the numbers at a pace that is normal 
for you. 


Any questions that the Ss had were cleared up 
before a!lowing them to continue. Actually, then, 
the Ss were emitting verbal responses. It was 
decided beforehand to condition Ss to the response 
class ‘‘8’’. (Any number containing an eight in 
it.) The verbal reinforcer used was a ‘‘right’’ 
from the experimenter. The criterion used for 
conditioning was 20 serially ‘‘correct’’ responses. 
When the criterion was reached, each S was placed 
on a 5~minute extinction schedule. The basic data 
consisted of the number of correct responses 
made in extinction as compared with the total num- 
ber of responses made. In testing for differences 
the question to be answered was whether the con- 
tinuous reinforcement (Rc) group emitted a higher 
correct response ratio in extinction thanthe group 
receiving partial reinforcement (Rp). 


Subjects 


The 20 Ss used were taken from a course in 
Child Development in the School of Education at 
Indiana University. Participation in the experi- 
ment was a required assignment; this precaution 
was observed in order to eliminate additional bi- 
ases which are found by asking for ‘‘volunteers’’. 
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TABLE I 


RATIO OF THE CORRECT RESPONSES TO THE TOTAL RESPONSES FOR 
EACH S IN THE PARTIAL REINFORCEMENT GROUP DURING A 
5-MINUTE EXTINCTION PERIOD 


Extinction in Minutes 





3 Total 
2/2 j 18/18 





17/28 66/97 
2/4 25/49 
4/6 27/48 
3/3 15/15 
1/2 26/56 
3/21 45/98 

11/13 30/50 
1/9 25/62 


14/20 57/105 





Correct 58 334 





Total 
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TABLE I 


RATIO OF THE CORRECT RESPONSES TO THE TOTAL RESPONSES FOR 
EACH S IN THE CONTINUOUS REINFORCEMENT GROUP DURING A 
5-MINUTE EXTINCTION PERIOD 


Extinction in Minutes 





1 Total 





$11 16/17 57/87 
Si2 16/22 64/109 


$13 17/19 48/75 


S14 24/29 57/95 


S15 17/19 51/102 
S16 10/16 48/97 
$17 21/29 46/92 
Sig 19/24 57/106 
Sig 26/31 58/105 


S20 29/36 65/127 





Correct 195 551 





Total 242 





TABLE II 


FREQUENCY OF FAILURES AND SUCCESSES FOR THE TWO GROUPS 
DURING FIVE-MINUTE EXTINCTION PERIOD 





Failure Success 





Partial Reinforcement 264 


Continuous Reinforcement 444 
Total 708 
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The age range was from 19 to 23 with a mean 
age of 20. 6. 


Results and Discussion 





Table I presents the ratio of correct respon- 
ses to the total number of responses for the Par- 
tial Reinforcement group during a 5-minute ex- 
tinction period. 

Table II, in like manner, presents the extinc- 
tion data for the group which received continuous 
reinforcement during acquisition. 

Figures 1 and 2 compare the plot of the mean 
correct responses in extinction with the mean 
total responses in extinction for the partial re- 
inforcement (Rp) and continuous reinforcement 
(Rc) groups respectively. Figure 3 shows the 
plot of the percent of correct responses in ex- 
tinction for the two reinforcement schedules. 

Clearly the design encountered in this inves- 
tigation involved a comparison between two fre- 
quencies or more precisely two proportions. A 
group of twenty Ss was divided at random into 
two groups of tenSs. One group was given par- 
tial reinforcement in the acquisition stage and 
the other group, reinforcement on each correct 
trial. After conditioning both groups to a com- 
parable criterion (twenty serially correct re- 
sponses containing a number ‘‘8’’) eachS was 


placed on 5-minute experimental extinction to 
determine whether the conditioned response un- 
der investigation occurred proportionately more 


frequently in one group or the other. The ap- 
pearance of the conditioned response during the 
extinction period can be designated as a success. 
The appearance of an inappropriate response in 
extinction may be called a failure. (Any number 
or set of numbers that does not include ‘‘8’’. ) 
The hypothesis to be tested then is that the two 
samples are random samples from a common 
population, and a Chi square test was used to 
evaluate the outcomes of the experiment. Table 
Ill shows the frequency of success and failures 
for the two groups during the 5-minute extinction 
period. 

The obtained Chi square value of 3.29 falls 
barely short of the required 3. 84 to be ‘‘signifi- 
cant’’ at the .05 level. The trends of the extinc- 
tion curves are indicative, however, that, if the 
extinction criterion of five minutes was extended 
the ‘‘correct’’ response differential between 
groups would have approached a higher signifi- 
cance level. (See Figure 3.) 

Analysis of the data indicate that: 


1. Partial reinforcement increases the re- 
sistance of a response to extinction and 
appears superior to continuous reinforce- 
ment in this respect. 





2. The extinction curve following continuous 
reinforcement starts :with an initial spurt 
in percent of correct responses. After- 
wards, the extinction curve is marked by 
depressions and accelerations in respond- 
ing. (See Figure 3.) 


. Not only is extinction after partial rein- 
forcement more resistant, but the curve 
is also smoother than that after continuous 
reinforcement. The vascillations which 
come after continuous reinforcement do 
not occur so markedly after partial rein- 
forcement. 


Although the investigation described was rela- 
tively simple the analogue to many complex hum- 
an behaviors is implied. For instance, the great- 
er smoothness of extinction for the Partial rein- 
forcement group might indicate that this ‘‘sched- 
ule’’ of conditioning may perhaps increase a per- 
son’s ‘‘frustration tolerance. ’’ Intrinsic to par- 
tial reinforcement is the recurrence of periods 
of non-reinforcement during which ‘‘frustration’’ 
is alternately experienced and overcome by con- 
tinued responding. Occasional reinforcement 
gives stability to behavior, and ‘‘persistence’”’ in 
the face of failure. 

Let us take a concrete example from the ex- 
periment just described. Eventually each § in 
both groups in the process of emitting numbers 
responded with a number containing an ‘‘8’’. The 
group (Rc) was told ‘‘right’’ every time they had 
responded with a number of the correct class 
(containing an ‘‘8’’). The acquisition here was © 
rapid, and as reported in a previous section, the 
criterion for acquisition was twenty serially ‘‘cor- 
rect’’ responses. (Those containing an eight. ) 
Remember that this group received a reinforce- 
ment (‘‘right’’) each time they emitted the correct 
response. The partial reinforcement group was 
told ‘‘right’’ only 50 percent of the time they emit- 
ted the correct response. For example, the pro- 
cedure was as follows: Each S would eventually 
give a number containing the required ‘‘8’’, a typ~ 
ical report being, — S says ‘‘38’’, E says ‘‘right’’ 
S says ‘‘48’’, E is silent; S says ‘‘58’’, E says 
‘‘right’’, ...and soon. In this manner the Ss in 
the Rp group do not meet with success on every 
correct response, and build up a persistence 
to failure. 

The obtained results clearly suggest a fruitful 
direction for a behavior theory of education. With 
the facts of reinforcement ‘‘schedules’’ we now 
have (Humphreys, 1943; Jenkins and Clayton, 19- 
49; Mowrer and Jones, 1945) some intelligent 
predictions concerning educational procedures 
with respect to the control of limited behavior 
can be made. Extrapolating somewhat, it should 
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Figure 1 


Extinction Curves Comparing the Mean Correct Responses 
to the Total Mean Responses for the Partial Reinforce- 
ment Group 
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Figure 2 


Extinction Curves Comparing the Mean Correct Responses 
to the Total Mean Responses for the Continuous Rein- 
forcement Group 





- 
oO 
lJ 
x 
x 
Oo 
Oo 
n 
iv) 
” 
Zz 
oO 
a. 
wn 
uJ 
x 
4 
@ 
x 
uJ 
> 
= 
=z 
uJ 
oO 
x 
WwW 
a 





JOURNAL OF EXPERIMENTAL EDUCATION 


i i | 





1 2 3 
EXTINCTION IN MINUTES 


Figure 3 


Plot of the Percent Correct Responses for Each Minute in 
Extinction for the Two Reinforcement Patterns 
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be seen how one would go about teaching a pupil 
to be persistent in the face of failure. In train- 
ing for skill, for confidence at work, or for will- 
ingness to persist in social activities, the teach- 
er should insure that each child is guaranteed 
some measure of success and approval regularly 
at first, but later only occasionally, so that he 
will not give up in the face of setbacks. Outside 
the laboratory continuous reinforcement is by no 
means the rule, but neither is strictly partial 
reinforcement. There are more complex ‘sched- 
ules’ of reinforcement (Skinner, 1938) such as 
fixed-interval and fixed-ratio. It is hardly to be 
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expected though, that any schedule adhering to a 
fixed number of responses would be honored by 
our complex social environment. Also, it is not 
the purpose of the present paper to discuss the 
relative efficacy of aperiodic, periodic, or regu- 
lar reinforcements in producing behaviors that 
are resistant to extinction as much of the exper- 
imentation has been done with infrahuman organ- 
isms. There is, however, no reason why exper- 
imentally oriented educators should not begin a 


systematic investigation of these operant phenom- 
ena on the human level 
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ADDENDA 


The following are corrections to Victor Mech’s article which is published in this December, 1953, 
JOURNAL OF EXPERIMENTAL EDUCATION, entitled ‘‘Resistance to Extinction of Two Patterns of 
Verbal Reinforcement.’’ The insertions are underlined, and quotation marks should have been used 
as indicated. 


-_s*e* * 


The lines including ‘‘those responses conditioned or unconditioned. ...are called respondent’’ should be 
in quotes and preceded by, Keller and Schoenfeld (1950, p. 49) indicate that: 





The lines including ‘‘the other class comprising... .of identifiable stimuli’’ should be in quotes and pre- 
ceded by, Keller and Schoenfeld (1950, p. 49) point out further: 





The lines including ‘‘most of our behavior in the routine affairs of everyday life....operates upon the 
environment to produce anything’’ should be in quotes and preceded by the following sentence, In dis-~- 


cussing the relative frequency with which both types occur in life situations, Keller and Schoenfeld (1950, 
p. 49) state: 





The lines including ‘‘it occurs with a low frequency prior... .increased strength means merely that it 
occurs with higher frequency than it did before’’ should be in quotes and preceded by, With special ref- 
erence to this concept Keller and Schoenfeld (1950), p. 50) state: 








The phrase, It is pointed out by Keller and Schoenfeld (1950, p. 50) that, should precede the quote ‘‘prob- 
ably the best measure of operant strength is frequency of occurrence... .it is weak when emitted rarely.’’ 





The sentence beginning, ‘‘A paradigm suitable for Type R....’’ should have been, ‘‘A paradigm suitable 


for Type R conditioning is shown by Keller and Schoenfeld (1950, pp. 47-48) along with the familiar Type 
S schema. ”’ 


The paragraph beginning ‘‘Type S conditioning....’’ and ending with ‘‘the small s of the Type R paradigm.’ 
should have been in quotes and preceded by Keller and Schoenfeld (1950, p. 48) describe the differences 
between Type S and Type R as follows: 








The sentence beginning, ‘‘For all practical purposes....’’ should be preceded by, With respect to the 
Type R response, Keller and Schoenfeld (1950) point out that 








The sentence ‘‘Type S conditioning involves stimulus....of anew reflex ’’ should be in quotes and pre- 
ceded by Keller and Schoenfeld (1950, p. 48) state: 





Schoenfeld (1950, p. 48) indicate further that: 





The lines including ‘‘In Type R conditioning, however,....stimulus-response relation is formed’’ should 


be in quotes and preceded by, A further distinguishing property of operant conditioning is pointed out 
by Keller and Schoenfeld (1950, p. 48) as follows: 








The sentences ‘‘This preference is not due to any oversimplified belief. ... exhaustive analysis of exper- 
imentally isolated situations’’ should be deleted and corrected to read, ‘‘A primary reason for the fore- 
going preference is that the probability of control over the variables being manipulated is increased, 
thereby permitting a more valid interpretation of the obtained results. ’’ 


The sentences ‘‘The number of responses in a complete extinction. ...and are therefore frequently e m - 


ployed. ’’ should be in quotes and preceded by, The ideal conditions for extinction are discussed by Kel- 
ler and Schoenfeld (1950, p. 72) who state: 








The first and second conclusions under Analysis of the data, should be changed to read: 





1. Fifty percent verbal reinforcement increases 
the resistance of a response to extinction when 
compared with 100 percent verbal reinforcement. 





2. The performance curve in extinction follow- 
ing 50 percent verbal reinforcement is more 
stable than the extinction curve following 100 
percent verbal reinforcement. 


The sentence ‘‘Intrinsic to partial reinforcement is the recurrence....and overcome by continued re- 
sponding’’ should be in quotes and preceded by Keller and Schoenfeld (1950, p. 91) point out that: 





The sentence ‘‘Occasional reinforcement. ...in the face of failure’’ should be in quotes and preceded by, 
An application to the training of children is made by Keller and Schoenfeld (1950, p. 91) who state: 





The sentence ‘‘In training for skill, for confidence at work. ...so that he will not give up in the face of 
setbacks’’ should be deleted and the following substituted: ‘‘With regard to building persistence in chil- 
dren, Keller and Schoenfeld (1950) state, ‘One would make sure, in training for skill, for confidence 
at work, or for willingness to persist in social activities, that the child is guaranteed some measure of 
success and approval—regularly at first, but later only occasionally. ’”’ 


The sentence ‘‘Outside the laboratory....is strictly partial reinforcement’’ should be preceded by Keller 
and Schoenfeld (1950, p. 98) caution that 





The sentence ‘‘It is hardly to be expected though. ...by our complex social environment’’ should be pre- 
ceded by Keller and Schoenfeld (1950, p. 98) point out further that 





Add to the references: 


Keller, F. S., and W. N. Schoenfeld, Principles of Psychology (New York: Appleton-Century-Crofts 
Co., 1950). 








CORRECTIONS FOR 
‘*The Statistical Interpretation of Degrees of Freedom’”’ 


by 
William J. Moonan 


The Editor and author are sorry for the statistical and typographical errors that 
appeared in the article as published in the March 1953 issue of the Journal of Ex- 
perimental Education. 
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